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Predictable Aspects of Clerical Work * 

Roger T. Lennon 

licscarch and Test Semee, World Book Company 
and 

Brent Baxter 
Ohio University 

The u.siKvl pi'ocediii'c in evaluating the efficiency of aptitude testa in 
the prediction of clerical work is to correlate tlie test scores with some 
measure or rating of sucotjss in clerical work. Few, if any, attempts, 
however, have been iimclo to determine wliafc .specific aspects of clerical 
work lire ndatcid to .scores on the types of tests most commonly used in 
selectiiiR clerical workers. This article de.scrihea ono such attempt, 
caiTicd out in (umiu'ction with the usual-type mvestigiilion of iho validity 
of two tests used for iircdicting clerical success. The study doscribetl 
was conducted in a large Rovernmeiit agency employing several thou.siiiKl 
clerical Wdrker.s. I'he plan was to have a gimup of clerical omployec.s 
rated on a of Kpecific stiiUnnents concerulug different aapccts of 

clerical worlc, and to note on which .statements ratings were related fiig- 
iiilicantly to ti'st .scoim 

The. TcMh. Tlic te.sts involved in this study wore a.s follows: 

a. Lcxiriwuj Ahiliiij Test. This is a local adaptation of Army Alpha, 
Kan.sas Uevi,si(jn (hy .Sehraminel and Wood); it includes six subtests: 
lU'ithinetie problems, eommou sense, same-oppositcs, rearranged sea- 
touees, analogies, and genoral information, requiring 27 niiniitoH working 
tiiiK! in all, It c(]ri'(*latn.H .88 with the Otis Quiclc-Hcoriiig Te.sL of Mental 
Ahility-dainnui Test. ‘'Liianiiiig Ability Te.st” is the (Icsigiiatioii used 
locally, and lusi'eiiiufter, to refer to thi.s te.st. 

h. ('(r.i'ind Aplilmlc. Tt’fil. dliis is a test develojual by the lUithovH to 
nuiasnia! simed and acrairacy in the performaiict! of siinjilc clerical tasks. 

* Aoliiioni(‘(j['iiifiit is gmlefully niiulc to Mks Kvciyti Patcchin for iiaaiMUnco in Llio 
Htiili.sliriil coiiipiitiitioas. 
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It ia also composed of six subtests: alphftbcti?.iiiK, numl)(‘r cliockinR. 
coding, digit counting, arithraefcic computation, and locaLiug infdrmntiou 
from tabular data. The test requires 21 mimitea of working time. Cor¬ 
relations of ,67 with the Civil Service Commission ClevieiU Examination, 
and .65 with the Learning Ability Test have boon olitniiied, 

Both tests were administered to practically all appllcaiiLs for eh-rieiil 
positions in the agency at the time of employment, but virtually no 
applicants were rejected on the basis of the tc.st resultH. 

The Subjects. The employees chosen for the study included all wlu) 
had the following qualificationa: (1) had taken Ijoth t(?.s(.s at tlu‘ time, of 
employment; (2) had been on the job for at least three nronlhs; and 
(3) were doing fairly simple clerical work, involving no anpervisory re¬ 
sponsibilities. The group originally chosen for atudy innnbeved about 
250, and comprised about 60% clerks of various kinds, 30% .stenograplnn-s, 
10 % typists, and 10% miseellaneoua workers such n.s clock cai d (‘litM^kers 
and bookkeeping machine operators.’ 

The Check List. One of the criteria which was used to evaluaU; tlio 
tests as predictors of clerical success was a so-called Clerical ('lieek Lint. 
This Check List consisted of a series of atatemeuLs coneeriung (he work 
of clerical employees. The method used in dcvelopinfi the Clw.ck InKL 
followed in many ways a method originally propo-sod by Brobst,* The 
validity of this method ag a technique for moasuring 8u.cct!.ss in idorieiil 
work is not discussed herein, since this article deals only witli Die 
individual items in the List, and not with any compo.site rating. It i.s 
not assumed that the statements in the List arc inclepondent. T’he 
entire Check List appears below, together with the direotion.s for filling 
it out which accompanied it. It will be noted that the List includes boDi 
favorable and unfavorable comments on the quality and ciuaiitity of tlio 
employee's work. The items are both specific and general; that is, Kome 
statements are pertinent to only a spcci&c task, such as tl\c tvauHcrihing 
of dictation notes, while other statements pertain to chariicLcristic.s such 
as neatness, orderliness, etc., which apply to all kinds of work. 

Check List for Clerical Employees 

pirections,' Below is a series of statements which have boon made about 
clerical employees. Read each statement carefully, and dccicle wlicthor or not 
It IS a true etatemont about the employee under considcviviion. Then put a 
^ons below statement in accordance with the dinw- 

atatem?nt^°^ statement is true, put a plus sign (-|-) beftjro iho 

>For the informfition of those familiar with the classification HyrfUsm Ui Federal 
agencies, these subjects may be identified as grade CAF-l, 2, or 3. 

‘ J. B. Probat, Personnel, 1031, 8, 20-24. 
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b. If you believe the statement is not true, put a "0" before it. 

(?. If you do not liave sufRcicnt knowledge about the employee to decide 
about the Btatemcnt, mark it with a question mark (?). 

d. If the statement is not pertinent to the work tlie employee is doing, 
mark it with "NP." Por example, if the statement snya something about 
typing, and the employee being considered does no typinE, mark the statement 
with "NP.” 

D. Place one of the n])ovo marks at the left of each atatoment. There may 
bo some special event which has helped you to <lecidft about a atatemont or 
Bomo apceial information. In these cases do not hesitate to note it in the 
column under '‘Comments." Code for MarWng Statements: True = +; 
Not true = 0; Don't know = 7; and Not pertinent = NP. 


Mark 

here Statements 


. 1. Uses the correct printed forms for each operation in his work. 

. 2. Cliecks on hia work have revealed that he makes very few errors. 

. 3. Can arrange tabulations and statistical memoranda in an easily 
understood form. 

. d. Mteuda ayatematically to mattora that require periodic attention. 

- T). Keep.s hia records up to date. 

. G. Is alert to notice the improper routing of a file or letter. 

. 7. Gets important letters out before the end of a day instead of holding 
them over night. 

. 8, Cliccka Ills work for errors before releasing it. 

. 9. Accurately transfers information to forma. 

.10. Has overlooked obvious errors in the work ho is handling. 

.11. Does a fair share of the work in his unit. 

.12. Often doc.s necD-ssary but um'equc.stGd work on hia own initiative. 
.13. Transmits raessagea correctly and intelligibly. 

.1-1. Has had to be corrected for the same error more than once, 

.15. Plas sufTicient knowledge of the work ho ia handling to detect ob¬ 
vious error,s, 

.10. Rarely mia.spcHs n word. 

.17. Some of the stencils cut have had to be retyped, 

.18, Sometimes forgets matters which flhoiild receive prompt attention, 
.10, Sometimes gets lost in routine end forgets important details. 

.20, Knows where to go for necessary information, 

.21, Ls accurate in computations and calculations, 

.22, Takes the easiest way when it nieftiia the results will be incomplete 
and not wholly satisfactory. 

.23. AVork hna sometimes had to be assigned to others because he ia alow. 
.24, Can, when required, compose a letter or memorandum that covers 
nil i)crtincnt points and presente all nece.s9ary details. 

,25. A "peak'' in work to be done discoiirogea him bo the detriment of 
ilia work, 

,.‘20. Alc.-ivunR9 work promptly after nn interruption. 

.27, Turna in letters w'hich reveal errors in I'higliali which were over- 
lookud. 

..28, Trias to avoid adflo<l reaponsibilitiea. 

. 29. Does l(!,sa work than other people in his unit doing the aaine kind of 
work, 

..30. Correctly compiles material, 

..31. Tyi)ecl lottcra are oconfflonnlly marred by ernsurca or etrikeovera. 
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Mark 

here 


Statements 


32. I0 eager to Jearn raara about the work of his unit. 

I33! His working instructiona have to be repcateu 
34, Avoids unneceasary duplication in his work. 

"35 Sometimes fails to have adequate aiipplics nnd nuxlvTiniH uu hnnd. 
..36. Has had to do some nt his work over beciiusc liu Jms jdurlcd bc/f»r(! 
clearly understanding what is to be douc- 

37. Carbon copies have sometimes shown folds, ereuHC-4, hiu\u 1(-(' i. cU'. 

38. If he ia assigned more than one job at a time, he luu.uini's 

L39. H& is faiftilitvr with the relation of Uia work to other work in tlui 

branch. r 

..40. Has started some new assignments without a eUnvr uiuU‘ts.t!ijj(liiiK of 

what is to be done. 

.,41. On his own initiative he has ohtaincu outside tnuuing wliieli liuti 
improved his effectiveness as a worker. 

.,42. Calls attention to possible errors in materials lioforf! Iriiniuirihiiit' 
them, 

..43. Does a fair ghate of the more difhewU toskn within tUn unit, 

-.44. Clieckg on his work reveal that he makes no iiii.sl.akcH, 

„46, The speed of note-taking (dictation) is aa fost «n l/io work (lenmiKi.H. 
-.46. Has used poor grammar in typing letters froni geueral diroi'liouH. 
..47. When he haato speedup becauae of apeak loiul, Uiuru ia an inimuiiui 
in hia percentage of erroM. 

.,48. Has made helpful suggesbiona about work handled. 

-.49. Some work has had to bo returned to him to ho dumi uve.r hcoaUKu 
of the quality of the work. 

-.50. Copies of work show an uneven typing toucU^ 

..51. Reviews hia work for discrepancies before turiiiiii!; it in. 

...62. Correctly usea the terminology of his job. 

...58. Difficult tasks challenge rather than confuse him. 

,..54. Has aoraetimea made the wrong nuvnhev oC eupics. 

...55. Has misdirected mail when sorting it for oflicc diiiliibiition, 

...56. Is often entrusted with tabulation of diflioult jnntori/ilH. 

...57. Quickly learns ■where and how to locate iieoplo whom the HUimTvit'\)r 
often calls. 

...58. Returns all letters, records, files, etc., to their jiroper pl/me pro/uiJlh-, 
...SO. Distracts or interrupta ft dictator unnecessarily. 

...60. Is confused by sudden changes in assignment. 

..-61. Botliets others by asking them hov/ to apcll WDyfl.s. 

...62, Typed work ig always orderly and well aligned. 

...63. Does not turn out os much work as the other incinlior.H of the. unit, 
...64. Grasps new rules, regulations and procedures qiiioki}'. 

• oS- Ib unable to carry on ^ectWely more than one task at a tiiiu!. 

■■■fiS' employee to whom tha mast difReult r.au gi v i-n. 

■fto equally well with or without close ^upoi vwion. 

...88. Dictators have to alow up becauBO of hia inability tfi taka diatutimi 
taafc enough. 

of acceptable quality eycn under prejiHure. 

...71/, Accurately agflertaina the business of visUotH and (liviuda tlioiii 
correctly. 

‘■■72 'iGw uasignmuut. 
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Mark 

here Statements 


.73. Checks and corrects auch items ns names, titles, addre.sacs, file rof- 
cronce.s, dates, etc., before releasing corrcapondcncc, 

.74. Desk and hies arc neat and oiderly, 

.75. Can iviialyzo records (luiclcly so aa to locate needed information. 

.7(5. Is frequently asked to iiinicc up apccinl memoranda. 

.77. Doc.h nnt iihvayssct up letters in accordance with rcigulatioms. 

.78, Is able to maintain the average rate of production of the unit. 

.79. Docs not detect inoon3istcncic.q in the miiteriul typed or trangcribed, 

.80. llemiud.s the .supervisor of his nppomtmonts if iie seems to have 
overlooked them. 

.81. Does not rciucmbor freqiicntly-uaed name.s and numbora. 

.82. bocaiiKc of Ids .slowness you sometimes hesitate to assign some jobs 
to Itim. 

.83. lias demonstrated ability to coinpo.se acceptable letters or incm- 
oraiula, 

-.84. In tranRoribing dictaphone rolls, can make reasonable interpreta¬ 
tions wliere the roll is not clear. 

.85. l^iRSCH on hlnnie for own errors. 

.80, Is al)lc to concentrate on duties despite the frequent interruptions 
whicli come with acting ns receptionist. 

-.87. Ila.R been known to make unnecessary dupliontion in his work. 

-88. Ilig working ia.Htruotion.s have to be repeated, 

..8!). In tlio use (if carbons with forms, the carboned material appears in 
tiu! proper sjiuccH. 

..90. Is inclined to sacrifice accuracy for speed. 


CiopicH of ilio Clicck List, with directions as shown below, were sent 
to supervi.soi'H of tJio group scJoctod for follow-iip. 

Direction.^ for Supervisors Marking the Check Lists 

1. 'Vhe I'erHomml Section is making a study of the effectiveness with which 
its aptitiiilc tests pri'di(;t the efliciency of its clerical pcr.soTincl, In order to 
(loinph'tc tliirt study tlie Socjtion is rc<iucsting thataupervisoi'H mark Check Lists 
like tlic one attached for some of their employoe.s. Only those clerical em¬ 
ployees who have been tested mul who have been on the job for at least three 
months arc being studied. These records will not become part of tlie perma¬ 
nent lilcH nor will they affect the Q\\n\ Service eftioieney rntings. 

2. It IS urged tfuit careful utteiition he given to cliccking these lists for 
otherwise they arc! worthless. Pleaso read and follow carefully the dircctioii.s 
on tin: fust ])ugc of the Check List. It is suggested that all of the statements 
on the r,ist lie read before any of them arc marked. About lifteen minutes is 
reipiircil to couipliAc a Cheek Li.st. 

3. 'I’lic immc of the (unjiloyee to 1)(« elmeketl is in the U[>])ci right Inunl corner 
of tlu! List. 'I’he iiiiinc of the suju'rvisor eheekiitg tlie List should be wriltcii 
ill till; upjier left-hiiiid earner of the lirst jiage. The miinbcr of weeks during 
which till' work of the, (uiiployee liii.s heeii roviewed by the supervisov indicated 
Hhnuld bi! wi'il ten beneath tlie iiaiiii: of the supervisor, 

4. It is believed tfiat then! is iiu need to diseu.s.s ilic Check T.ist with the 
ciiqiloyiic unless it is specially desired. In any oiise it sliouhl not lio discussed 
until after the clicckiiig lias lieeii done. 

5. iMca.se return tlu:.sc Check Lists completed to your Brunch Ohief williiii 
four days. 
















6 


Roger T. Lennon and Brent Baxter 

No aupervisor was asked to complete Check Lists lov (oviv 

employees and most supei-visors had to mark only one. I'ivevy I'n'ovt 
made to have the checking done by the immediate BUi)ervisoi-. Most of 
the reporting supervisors had about fifteen employees uiulcr (luuv duco- 
tion, As the Check Lists were returned, each one waw reviewed (o hoc 
that the marking had been done according to directiona, and that the 
proper supeiviaor had marked it. Of the Check Lusts Hont nut, worn 
returned. The chief reasons for failuro of all the Check Lints ID he 
returned were separations of the employees or the supervisurH, mid Iho 
transferring of employees to different supervisors. 

It is realized that highly accurate ratings were not in all ensos ob¬ 
tained from this group of auperviaora, many of whom wore unfriiinctl 
in checking the performance of employens. The supervisors’ cliecking 
was internally consistent, however, the correlation being c.HLiiuahMl as at 
least .85. Some evidence was obtained on the agi’coment between siiper- 
visoi'son the total Check List score. A group of 02 employees woi'<! rated 
by two supervisors, the correlation between pairs of supervisors' ratings 
being ,69. No evidence is available on the reliability or validity of the 
marking of the individual items. Since these Check List ratings ioave 
much to be desired aa a criterion, any findings as to the numlxu' of itonis 
predicted significantly by the testa are likety to eiT on the conaorvtvtivo 
side. 

Results 

After the Check Lists had been filled out by the suporvisora in acoord- 
ance with the procedure described above, an analysis was \indorlakon to 
determine which of the items were significantly related to seove.s on tlui 
tests given at the time of employment; that is, which ones couhl have 
been predicted, to some extent at least, on the basis of test vseores. hrum 
the total group for which Check Lists were eoiuploted, a group with 
high scores and a second group with low scores on the Learning Ability 
Test, constituting the highest and lowest 27%, were solcetod. H’lic 
number of cases in each group was 58. A tabulation of rc.spon.scH to 
each item was made for these two groups, yielding for each item the 
number in the group for which a "0," "NP,’' or liml Ixtcii 
recorded. The results of the tabulation appear in Table 1. 

The statistical analysis in this paper deals only with tlio priiportion 
o£ the high and low groups fox which each item was marlciid i-c., 
true. The proportion considered was the relation of the nuinhev 'in (hn 
group having the item marked "4-'' to the sum of tho “ + " and "0" 
markings. Thus allowance was mode for the vcsponse.s, rolhicting 
inadequate knowledge on the part of the supervieorB, and for the "NP'’ 
responses, so that the proportion for any item is based only on thoso 
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individuals for whom the item is appropriate—e.g., typing items for 
typists, It was sometimes found that the proportion of "NP” ’a marked 
for an item was significantly different for high and low scoring groups, 
reflecting differences in the kind of work assigned to low and high scoring 
people, Inasmuch as this study is interested in the prediction of quality 
and quantity of work rather than the kind of work, these differences will 
not be discussed here. 

The ohi-sqimre test was used to evaluate the significance of the differ¬ 
ences between the high and low groups, and those differences for which 
P was less than ,10 were regarded as significant—in other words, these 
differences which were at the 10 per cent level of significance.'’ In the 
calculation of Yates’ correction for continuity* was uniformly used 
to provide a more refined test even when the numbers of cases were 
sufficiently largo so that it was not strictly necessary. Use of tins tech¬ 
nique is illustrated by the following example, which is the calculation of 
chi-square for Item 24 for the high and low groups on the Learning 
Ability Teat. 



For X* = -ihlS, with one degree of freedom, P equals approximately .30. 
Therefore, according to our standard, this difference is not significant. 

On the basi.s of this aualy.sis, 12 items wore found to differentiate 
significantly between the high and the low groups on the Learning Ability 
Test. Tliesc ifcein.s are indicated in Table 1. 

The same procedure wias foIl()^ved in determining which item.s were 
significantly related to .score.n on the (.lloriciil Aplitucic Test, Iligh- 
Bcoi'iiig and low-scoring groups on Lliis lest, again eonsbitubing the highest 
( 111(1 l(nv(!.st 27% of tlie total group, wore selected, and biiliulations of the 
respoiiHCH for tli(!S(! groiqi.s, because there is a siibstantiiil eorre- 

> III Llici Iiclmil cDmi'iibiUoii of x’. it ’h not ii(:('c».Hitry to oompiiUi the ])roi)orti()n.H as 
Hunh, Himio the ciilcoliitioiiH lire ijcrfoiiiieil in Lcrins of freciuericies; hciico tlicao propor- 
tioDH iiro not iiieliided in Table 1. 

‘See Gouldcn, C, Ih, Methods of nhUiHlical anahjsU. New York; John Wiley and 
Sons, 1939, pp. 102-100, 



Table 1 

of Responses to Check-List Items for High-Scoring and Low-Scoring Groups on Learning Ability and Clerical Aptitude Testa 
Leainine Abilitr Test Clerical Aptitude Test 


8 


Roger T. Lennon and Brent B(u:U:}' 


IziSaralzi y. y.'A y. v. 


0 

0 

CO 

0 


lO 

0 

d 

M 

0 

0 

cO 

0 

-r 

Cl 


0 

ro 

Cl 

-h 

tO 


« 

d 

91 

CO 

0 

to 

cn 

Cl 

0 

to 

0 

fH 

F -4 

0 

^1 

CO 


F-, 

1—1 


CO 

d 

d 

CO 

• 4 ' 


F^ 




c? 



Cl 

Ip 




0 

CC 


Tjt 

0 

cn 

0 

■n 

F^ 

l- 

-l' 

Cl 

Cj 

r —1 

Cl 

m 3 

CO 

w 

Cl 

•0 

0 

*r 

0 

•I* 

!•< 

d 

05 

00 

d 

10 

fH 

00 

CO 

(O 

a* 

CO 

to 

<£> 

to 

Cl 

lO 


i-. 

10 

'O 

t 3 

'tfl 

r-l 

CO 

fO 

M 



CO 


10 

Cl 

Cl 



C '5 





0 


W 

CO 

fH 

r—% 

0 

0 

0 


- 

d 

Cl 

Cl 

r*t 

tP 

CO 

0 

0 

- 

n 

0 

OC 

d 

b- 

10 

0 

d 

CO 

cl 

0 


CO 

0 

0 

ID 


■ 4 ' 

CO 

0 


Cl 

l-l 



d 






t-> 




ni 




0 

M 


Q 

Q 


d 


ri 

01 

0 

CO 

¥-4 

0 

CO 

10 

0 

1- 

1 - 

Cl 






l-H 






r-i 


10 




'r 

-r 


XO 

lO 

r- 

<4 

0 

00 

10 

d 

o> 

0 

r- 

O) 

Cl 

CO 


Cl 

1—4 

1 ". 


40 

10 

IP 

n 

O' 

iO 

CO 

CO 

10 

•«n 

lO 

CO 

CO 


■n 

■' 1 ' 




in 


,60 ^ K a 5?; ^ ’A'A'A ■/. 03 Vs 03 V; 03 V'. X. V'. z'- 

03 


Qonoo noMi-tfH dfoora*-! 

5'^SSS3 «sr-«co 

r-' CO 01 M V N 01 Cl 10 

oo»t-i«o ooo-^do dddcncn 

m (M CO ■'f ’I' 

2S25S2iS ^oomeorn >o«£)o>if5co 


o a to •’H i-> t-HOpHo 


^ t-jfoci'-io eociO'-'eo 


N % « J:; O O 03 OT 10 ^ ^ 

k< 

u 

tt o •Hcoodee ui^iopkco c^or-mco 

’•I’ ,-1 v,! ^ 

+ S?3e3S:: 


bD o 

& 1 ^ N er> 

2 « 8 

O S 5 


•o COt^OOAO -HNCO't'iO C3 i-~QOO>0 



Prcdictabh Aspects of Clerical Work 


9 


o 


L'i 


O 


wl^^l^co Izi^coZa 


•H m -H s o 


« "T o) CO n 


W -H O T|t .-1 


McqiHo^ ot^cieso no(o®o coociwo 


cO»OMN S^WOC^^ rHCOOOlO® 

C 9 rtijl rl’ctt Wi-llO 


l->cO'Ha>cs| c)t|i^oo >-4 wrocDinh- looi-icoo 

.I to fOiH thCO 


00 r-l !•>. lO ^ «0 «0 CO 03 CT M fh ifl 05 W '+' t- CD 
^ CO '^•>(1 WOIfh 


OQOOi^ ihNOi^O 05-hoO'^ cO>H'«Mi-( 


OOSrHOr- ■<ftHOi-il-' P-ICOWMIO MlM<0rHCS 
•H fl W N >H CO 


M lO TfiioN^ ■^CS 


OtFCOiHO> a05U3':fl0 tOObFO^* 00 
‘0 CO ^ U3 10 


N O 

•V ’t IH (N 


'A'A'A^iYi 'A'AiinA'A, </)'Au^'A'A A'Am''A'A 


iHMOOfH O'^'^'OO MO'-'OfH 


O Cl 'K -p Cl 05 CO N t-F 05 fH O 't' 00 O O CO CO 10*0 


CO lO Cl "P 

fo n 


o 'O CO fh ei 


tp If at CO CO Cl CO >0 05 (f at ^ 


CO If -f! 
CO ■+ 


•*P Cl —I fO i-« 


F-ifFcocoiF cotFdcoro tO”^'-ieo>^ if-hio-oico 
lO to 'Pf-I-'I' i-H i-HTpT-i eOCOFn 



Cl 

o 

CO 


fH 

CO 

- 

o 

- 

- 

■cH 

o 


O 

Cl 

o 

CO 

CO 

tH 

27 

•H 

•—1 

CO 

FH 

'O 


o 


o 

o 

00 

CO 


to 

d 


o 

Cl 

o 

M 

fH 

If 

o 

CO 

o 

CO 

b- 

w 

O 

e: 






i-i 



rp 

Cl 




I-H 


Cl 




rH 






e_i 


•*1* 

CO 

l- 

r/1 

Ol 

o 

« 

1(5 

CD 


Fi' 

to 

O) 

_ 

•11 

If 

Ff 

05 

»0 

to 

CO 

o 


»o 


to 


Cl 

’P 

lO 

Cl 


•o 



Fp 

CO 

f 


•P 

I— 1 



CO 

CO 

to 

CO 


o 

-•v 

o 

05 

>o 

••p 

05 

o 


If 


CO 

50 

ID 

Ff' 

cO 

iC. 


05 

%n 

o 





Cl 


•o 



CO 




•n 





T 



CO 





n 

CO 

•1< 

to 

CO 

If 

00 

05 

o 



«o 

•P 

lO 

cO 

If 

CO 

OI 

o 

I— 1 

cs 

CO 


lO 

C'\ 

Cl 

C'l 

C{ 

Cl 

Cl 

Cl 

Cl 

Cl 

CO 

CO 

CQ 

CO 

CO 

CO 

eo 

CO 

CO 

CO 

Fp 


Ff 






10 


Roger T. Lennon and Brenl Baxter 


! 




• ^ 

u 

in 


Z ZooZZ 

ZoaZZZ 

Z «3 W W 

w z z z z 



t~ 

rH N Cfi O G 

PS N »n i-H o 

O O O O •-H 

d o o OS Cl 

IQ G O CO p< 

s 

B§ 

p 

Z 

® n 10 N ^ 

<11 G OD U> «P 

r-1 r-l <0 <!• 

O N t* *«] H-* 
u* CO •-< CO 

^ ^ CO M o 

^ ^ (O 

IQ -r 

H 


o 

CO O M « 

Tji pq M I-H 

U3 <ti (D lO Cl 

rH rH rH 

N IQ M -H US 
d 03 

O (0 G *s< I-I 
<f <3< rH cO 

0)0 1-. G pH 

PI .H 

'+» 

iJ 

+ 

O rt ^ '-I 

rt CS •# O 

oi « fS 

fH 05 d 
>1 d CO 

CO OS ® O ‘IS 
•-H •O' -« 

P I- O CO o 
do* OHp-. 

1 

■g 


»■< 

rt rH CO O O 

O CA CO PS O 

O i-i « o o 

CO O d O' 

O' O O P-* d 

a 

6? 

P 



CHI M G r< US 
CO d d 

CC G d O G 

G o ejj PH CO 


1 

o 

CO lo m <o >0 
« V rt •>Jl rt 

<P po ® ^ »0 

CO Hjl CO (>• 

CO O' 

S ” £3 

^.orjdPH 



+ 

n o 00 o H 


o <!• p* <0 e 
d CO ’I' 


?J 3 ''' 3i 



« 

tb 

«n 

03 

Z!Z Z Z Z 

z z z z z 

z z z z z 

Z Z cfl w CO 

Vi Z Z Z Z 



»■• 

O N HA O O 

•H US «> o G 

O O O G i-H 

d c? o >-' p^ 

<!' o o CO ei 



Ah 

% 

vs CP pq r- >-H 

CO 00 b» G ^ 
•H iH CO U* 

t'- o co CO ® 
eO os ■-* PS 

P* CO CP G o 
W CO -H 

G PH ® G 1- 
o* *r 

1 

to 

0 

o 

+ 

M cO H Ul <p 

H 05 05 t-l 

PS ® CO 

■-H PS M 

G '0* US US CO 

^ M M 

QO ■-( .^ !>. M 
CO « P5 

O G d CO 

T-l d CO 

i-< d O r-H d 
•-* d ■«i' j-H 

« Tf o CO ro 
PS <f •-< CO 

>H G d o' to 

I-H IH >-l 

O --H N l- O 

CO PH 

« O Cl PI G 

PH O’ O' 



C-i 

cs o o o 

O US U5 H H 

O H H H O 

N O M PH M 

G O 'p' pH O 


i* 

Ah 

a 

U us CD HO PS 
N es 

'<' N 00 Cl CO 
tH Cl «(i 

H » p. CO t» 
'CM d 

N O Ti' d CO 
d 

pH O PI CO IQ 

—H CO O' 


4) 

S' 

p 

9 


uj CO OS US CO 
CS r-t 

tf « Til O Tli 
CO Tjl 

G G G <]l 0< 
O’ 'O' O' 

G 00 ^ 10 pH 



f 

>-l H O ^ 

W 05 H 

® 00 CO O iH 
^ 00 CT t-i 

CO « G Til p. 
>-H d -O' 

01 CS G rt IQ 
CO IIS 

G eg PI o d 

d IQ O- PH 


Group 

U 

S 

_ O p. 05 o G 

9 HjH *0 ^ 55 

H 

<J PO ^ US 

US US lO US US 

G t>< 00 OS o 
IQ >4 US US CD 

13 S 3 3 !a 

G IH DO O) o 

G G G G Ih 


\ 



Table 1 —Coniinned 


Predictable Aspects of Clerical Work 


11 


'A'AV.yPA DO w 5?i J?. w CO Sq ^ SS 


^ K 

H S 

ft) is o 

>3 


•I'O'-HC^W Or-iOOO eOO'^O'-^ OCTMOi-l 


COrOftOtOO) C1ClC0^«-< b-<Di-llO^ 

Oll^MCOtO ^^CQC^CO M^C0O«O 


«-}<C'10'-< WrHOMrH ecO^Wi-* O-^OrHO 


Cl'-'CIOW OeiNb-W5 000400 10 0 n*#o«oo 
rt*-ii-*i-lMrteo Nio M' N 


PI CO CO ••j' lO 


V', /, /q y,'y y,y, i^. y,y* yp/A'A'yy 


TfplOr-lrH OOOOrH PlO'^'-tO OM-'OfH 


OO'OmO wOWJCOO ■>}*C004<*50 

lOCO WCO^ COCOi-l rpin FH "S' 

l-COWOleO Oli/>C>-O«l' t~0'»l<0t0 NfhCOOOO 

i-4rHN >r3 -Ijirf 'fl 

i-HCO-HOr« OOeOCDlO-'l* OOWOO^ NP-N'OCO 

-fPIIOCO phf-ii-i 


OF-iOMr-t MO-^Of- OMOfhO 


tOeOOOM COeOCOCOM* |-CO>NtOFH c^iq-hIOiD 


a o Ml I- en Cl Fit CO w « o Cl m t- ci o S F2 ?2 

q] f-i cO CO M' M' lO mi ‘O 'I* 

Uj 

I lo lO <0 -P !■» Cl P4 00 Fi M' CO o w >C3 i/J Tf iC Cp M* 

'r -ii eo *0 CO to d C'l ff m 


CO o 

fl X 

.-. r . 


I ^ aP^rin^ti^ SPfSKS 3SaSi2 SSSSSi. 
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12 


Roger T. Lennon and Broil Haitn 

lation between the Learning Ability unci the Clerinil ApliLnle tn.sl-s tlie 
highest scoring groups on the two testa included inniiy of (lie siiinr indi- 
viduala, as did the lowest scoring groups. U was found (hat 2r> Uoms 
differentiated significantly between the high scoring and lint low .scoring 
Clerical Aptitude groupa. adliering to the siune crilci ion of sigmliciuice 
as above, via., P les.s than .10. These items are indicmiid in 'I'alilo I. 

It will be observed from Tabic 1 that of the 111) .slulmu'nls covnrd in 
the Check List, 28 were found to be signUicantly relaled l(p .‘iiiorcs on ooo 
or both of the tests used at the time of cinployjnMit and li(‘jn'(? are (,o 
some extent predictable through the use of fche.sc! Lesls. Nine ihun.^^ ar(! 
significautly related to scores on both tests; three are incdictahle by Urn 
Learning Ability Test but not by the Clerical Aptitude and nixUani 
are predictable by the Clericid Aptitude init not by th(5 Lein iiing nkbility 
Test. 

Discussion 

In order to see if any generalizations could be drawn about the inoure 
of predictable items, as compared to those not ])re(li(;t(!d, (ho itonis won* 
grouped aa well as po-asibk into ijcveral roughly homogoueoiiH eab'gorid.s. 
While some items fell readily into the gi‘ouping,H, many .slalemcnls wcj'c 
difficult or impossible to classify. Some seemed to lit almost (Sjnally 
well into more than'one category. An attempt Iui.h Ixmui madi* to give a 
name to each group but the specific items thcmselvij.s slionld bo (“ouHiilldil 
to understand what ig implied. From a sliidy of Ihn itcuiiH as tinin 
arranged, the following findings wore derived: 

(1) Understanding of the work (Items 20, 33, 30, '10, '18, (ll, 71 , Hi, 88): 
Of nine items in the List which dealt with this subjeiit, (uglit \vor(> priy 
dicted by the aptitude teats. 

(2) JUirors in performance (Items 2, C, 9, 10, 13, 1.5, 30, '12, l l, 17. 1!), 
54, 55, 69, 70, 77, 79, 90): Of nineteen items dealing with l.lu! aiKuiiacy 
of the work, only three were predicted. 

(3) Quantity and speed of work (Items 11, 23, 20, 13, .57, (i:i, (i(i, 68, 
78, 82): All ten items in this group Were predicted except Itdin 11, wliicli 
was marked "True” for practically everyone, and Item (iS, whit'.h deals 
with a special skill (note-taking). 

(4) PerJormance oJ multiple tasks (Items 38, fi.5): llolh iiviiis aic con¬ 
cerned with the ability to handle effectively move than ouc, liwk and bulb 
were predicted. 

(5) t/iiTiecewy duplicalion in work effort (ILoimh .'(1, 87): Of tlu! two 
items in this group, both were predicted by the Clerical ApliUale T’esl, 

(6) Tmng (Items 17, 31, 37, 50. 62, 79, 89); No itoni dealing with 
the quality of typing work was predicted. 
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(7) <S7i'irI/i*Mn/ (Ilv!»s ITi, ,V.l, 08, 72): Nt» item nvas pTciiiclcd. 

(H) (irmninitr nud (Kpiu.h Ifi, 27, '10, 01): No item was pre- 

(licU'il. 

(!)) (Kfins 3, 21, ">(>, 70): No item was predicted. 

(10) r/icrt in*; ••/ ojn '.'! (lli'ins H, 01, 73): No item -wus prciliotod. 

(11) ihthrUiv'::i Hlvnis 1, a, ll.'i, .08, 71): No item waspredioted 

(12) dt/diiJ- '. Itnrurd v'nri: mid "pirniinulifi/" Inn'lji (lUaas 20, 20, 2S, 
32, 00, Ho, SO): N'd ilem wsei pic(liel4'r|. 

Siimiiiary 

In a (“Miiiiiaii'a.ii o| v.’dinit-s on u OI)-ilem (Oseek Liat for Clerical 
Wiirl{er.>^ uiHi (miiriv? on an inlelliK<'iieo le.sl and n clerical aptitude test, 
(Ik; results iiHrn“!il«‘il sevi-nil as|ii'e(a of elerical work wliich arc “pre- 
dieliililo' on ilic luois of tlier o (esis, l>ut poinUal on (ho otlior hand to the 
need for scjiaiaio lesi'* in lypinn, sliortlmnd, Htutistios, grammar, and 
spellini' for po-iiions in wliieh (licso uliililie.s are rcrniircd. Even with 
(liiH inori' rrini)i1ei(' led h-ry, it is prolialde that only a portion of the total 
viLi'ianci' in oii'ilic-juli perftu'inanee would ho predicted, for it ia not 
assuiiK’d lliai llir rio ^-k Led eovred adeipnilely all aspects of perform- 
uiK'i'. As iiiiidi^ !'■' antieiii!i(ed. lli<; a|>tiUnl(5 tosis did nob picdiob any 
of (he 1 n-e;ill< d “p'‘^'•'"'^'5di(y fiiolor.s.” The (tleri'-al A))liludc Test was 
cllieidiil ill pH'ili'-liiu' epi-ed. nmotiid, and under.slanding of work Liub was 
<le(iei'')i( in prctlicling arniniey. Tliis limy lie <lue to the nature of this 
piirlieuhir , wliich r;: eciiiipo.s<'d of ji seri(‘s of Khort suliLosts, and places 
a preiiiiniii on (piiek gi'osp of direelioii-s and rapid work. Few errors are 
made on Ilir (< ‘d, .'Uid (rtlu-r stmlie.s havi; indicated thiit these evrors have 
little sii'iiilii'aiii'i' in predieliiiK oii-llie.-jol) perfurnmnee, 


Kfcnvii'd /iii-imlnr /a.'.s. 



A Study on the Use of a Work Sample 

Marion Steel, Benjamin Ballnaky, and H&icl Bang 
VocQlional Advmry iicrvire, New York f 'llr/ 

The O'Rourke “Ringing an Electric UrH" ^Vi)rk nn^niiR inniiy 

other work samples, has been used cxiicriincntully iuj u dcvict! for nrouriing 
and developing interest in various occupnlions.^ Aliiml llirotf yours ago 
a number of Dr. O'Rourko’a work samples were used in tbo. NYA Imlh 
to give short work experiencea in various trades ami to proN’iiid a inonsurc 
of suitability for training in n specific trade. 

The Vocational Advisory Service Icntntivcly iii<i\ided the, “Uingiug 
an Electric Bell" work sample as part of ita psycliologioal IcMtiiiK program 
about one year ago and set about to cvfthmto it i\i lln> Himm time, 'i he 
"Riuging an Electric Bell" work sample was duwcu biieaufic an iinpiih- 
lighed report stated that the time bcotcs of tlio (‘leclrleal work Maniples 
were found to have product-moment coofRcicnla of v.orrelatiou of nln'ut 
.60 with the ratings by foremen on the work of lrain(ic.s in nmohiinieal 
jobs such aa machine ahop. Other aamplcN, such as one involving wood¬ 
working, gave much lower correlations. The "Uingiug lui Mlectrie Moll" 
work sample took a short time to adminislcr, wan cluiiii) in oohI, iiHing 
less expendable material, and waa easy to act up for the next client,^ 

A try-out of tlio work sample, preliminary to the ac.luid (ixiinrinimit, 
indicated that dexterities were involved in wiring llio unit and al.so tliat 
the experience of those working on the sample wi\h a factor to ho o.nu- 
sidered. Remarks by those taking the work samplo also indicatiul that 
the material waa mtereating. With these oKservations in ininrl, tlii.s 
study was designed to throw some light on the dexturitiea involved in llui 
work saraple, the effect of experience and the rclalivo degreci of inUu(’.sl 
shown in this material, in comparison witli usual testa. 

* Bulletin: Institute of EducftUon®,! Jlcwsatch, Tc&chnyii' tkjllrgo, (Idlnmhiii llniver- 
Bity, Qnd the Civica Reacnrch Inatitute, WnBliiiigton, D. 0., I'cili. 21, lOIO. Ivitiu.n, 
Harry D.: Creating vocational intensta, Owupalwna, 10.12,20, ri(l7-.'i7l. 

' The work sample waa nctunUy tomitl to bo practical for Linio mid ciihI, llin iivcnigi) 
time taken to complete the samplo being 13 minutos and 40 ficcondH. It ciui bo Hloi)(iO(i 
ftt the end of 26 minutes since only 8% ot all the aubjccU were rUU working at that 
tuna. The only expendable material -wne the wire nnd this cost about per pornon, 

U 
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Di'snriptiou of Sumpling and Teats 

For (I period of (.wo moiilliH the “Ringing an ElcRtriG Bell'" work 
sainplo woH gi\’oii I o a randomly suloctcd group of clients wJio caino to the 
Vociilionid AdviKory HiTvinc for vocational guidance. Selection waa 
limited (iidy to the. extont that the jicraon was nt least an elementary 
.school graiiualo and lielwceii (ho agon of sixteen and twenty-five. This 
age group represi'nls (lie Imik of the Vocational Advisory Service clieiitB 
who coma for giiiditiu^u. dionls were uIho given sonic of llie battery of 
tc.sls onliniirily luliuinistenid in voculimial guidance. 

AL the, end of two nuuitlm, the sniiijding consisted of 86 individuals, 
40 nuile.H and 'M femnleH. The median age for the total group was 18 
years and 0 moiilliK. The median cduentionnl attainment was high 
scliool gradualioii. lOiglity-four per cent of the males and eighty per cent 
of tiu; fiunalcs liad c.oiuphdcd either Home portion of the high school course 
or wore liigh school graduates. 

Ill udinini.Htt'ring tlio work sample, the following materials were laid 
out liefore thi! Hubject in a .standardized manner: an electric bell, n push- 
liuLton, tlii'co feel of insulated wire, a number 0 dry cell, a penknife, a 
liair of cutting iiliiirs, a screwdriver, and a ruler. The subject waa also 
provided with u Hhect of in.slructiuns giving detailed step-by-step direc- 
ticiiH as well as diagrams.* J'Jnch subject was examined individually. 
Tlic worlc Harnjih! was introduced by the examiner aa follows: “This is a 
job in olecLriciLy wo would like you to try. You do not need to have 
cxpoi'iencc witli this kind of jnatcriah Just follow tlie directiona on tlie 
shocL. Sturt right here, (Point) You have all the material you need. 
Work iiH (piickly as yon can and be huto to follow the directions." 

TIu! total time wiis taken, including the time spent in reading direc¬ 
tions, Sjicecl was not cmiiliasizcd but the stop-watch was plainly visible 
so that the subjects might be aware that they were being timed. The 
final instruction was to ])rc83 the pushbutton and the work was con¬ 
sidered complete when tho bell rang. The work was stopped if it was 
still incoin])l(!te after thirty minutes. 

'riie regular test battery included the following dexterity testa: the 
O’donnor Finger and Tweezer Dexterity tcsls and the Minnesota Rate 
of Manipulation, Placing and Turning tesl.s. On the Finger Dexterity 
Lc.st, in accordance ^v’ith the practice of tlic Vocational Advi.sory Service, 
the total time for tho ontiri! board was used ns the Hcore rutlier than the 
seoix! sjieeified liy O'Cloimor. Tlie scoring melhods of the authors of the 
tests were used for the others. 

* iSi 2 (! original (liicclions aiul (UngrnmB by L. J. O'Rourko, Civics Itcacarch Institute, 
3500 PaLLcrsou Street, N.W., WBahliiglon, D. C. 
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Experimental Procedun* 

The clients were divided into Uvo Rtmips. In A (lui ly-HirfT. 

subjects); the aboYC-mentioued four dexterity ti-.-ls v/i-ri’ I'lwii lu'ioifr [he 
worksample and in group B (forty-tliree Hiilijects’), llif ..rdn-v. :i:i rr^ rn^ed. 
The four dexterity tests were nefver given to more [linii I wci .Mibjvels nl 
one time and the work sample was ulwnys given iinlividiialh'. 

The work sample wus admiiiislered iii(livi<lu}i))y in onli-j- Iti nllnw for 
careful observation of the hniullmg of Uni tooln nml nmliuiii!;! urn! Um 
approach to the task. The examinew cimifuHy n-cmdi'd Uu- lo-e of 
directions, facility in handling the tools uiid inatcrml, iniliul 
to the task and the reaction to diflicuUic.s as well ns .•iponl inioouH i i'miirlvs. 
This was done in order to investigate the poPiiibilirivK <'f e;d;ililii;lung a 
qualitative rating. Each saibjGct was interviewed bridly .'ifici' flic fc.sis 
and the work sample had been ndminislcrcd. I'he f»illov.ing (pn-itioiH 
were asked; 1. What have you done before thal' wns liko Ibis?; ‘2, linve 
you done any shopwovk in school, repair work arnmid dm Iuuim', or n 
car?; 3. Which of these tests did you like buHl? Why?; ■!, ))i(l you My 
harder on one than another? Which one? WliyV; nud 5. Wliicb ^Yn:^ 
the easiest for you? Why? 


Eesulta and IntcrprchUion 

Pearson prodnctrmomenfc correlations were cnleulafed be¬ 

tween the scores on each dexterity test mid tlic lime ^•eol■<• on Ihc* ^vl)l'lv 
sample. The Minnesota. Spatial Eelatione lest ami Uu; U'llourkr N'minb- 
ulary test had also been given 'oa part of the battery cif (esls ami I'eai sim 
product-moment correlations were computed betweoji (‘.•icli of llicse Icsls 
and time taken to do the work sample. 

The figures in Table 1 indicate tliat the GorvelationK uu* low luul llmli 
many of them are unreliable. Corrclatious beUvc.oii dexlerily 
usually run somewhat higher, in the order of .‘10.^ For lln; inule.s, tin* 
correlation coefficients between the dexterity tests and the work sainjilc 
are very low. This might be interpreted fl.s incMiniiig tliiit the worlc 
sample is not measuring the same functions ns the tlexterily Ic.sis- in lln! 
case of the males, The correlations for the females, ;i!(hn\igh low, me 
higher than for the males and approach the order of ,10, TIk' (lillVivuci'.^! 
between the correlations for males and females arc Nignilicnnl, in only I hr 
case of the placing test. These results must be iuUiVpre.Ic.d in I, he light 
of the relatively small samplings. 

The number of male and female eaaoa are tiui .sitiaU Ui make, unv 
definitive statements about sex differences but the hoysuimle sigiiilieiuiMy 
M.i andCanclee, B.,Tli8 selection of doparUncntfeton;))iu‘.ki‘rH uuil wriiiiin r;) 

witii tlie aid ot witain hate, J, oppl. I'ayehol, lt)U, 25, 7(i-8.'). 
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.1 Siwhj „H th^' JJsrnfn Work ,'-iamplp. 


Tallin 1 

( ol W urlv F{iiii|il<' with ynTimi.H To.hIk 


Tr .1 

P-s 

N. 

r 

l\K T 

Higniflc/incc 
of C'onelfilion 
DifTorenepH 
lliitwcea jSoxps 

I'iii^cr lU'',l''ii(y 

M 

ill 

.07? 

,onrk 



I' 

:i’» 

-.'Ill) 

.<)!)» 

2.00 


in.tli 

HI 


.072 


1'rxi'-rily 

M 

•h) 

.170 

.ou:) 



l- 

ll.'i 

.lit) 

-OOt 

1,83 


P»<(h 

Kt 

.2u:i 

.007 


I'ifif'iiig 

M 

■10 

-.01(1 

.000 



V 

;iri 

.‘lOS 

.080 

4.0 


in.dt 

K1 


.070 


Turning 

M 

■It) 

.007 

.000 



I’ 

;ir, 

,;W7 

.101 

1.8 


iti.ili 

HI 

.liw 

.071 


Mimic,'i>t:i Siiatijki 

M 

'Id 

.217 

,001 



V 

:t'i 

..'10.1 

.000 

1.1 


Uiilli 

H'l 

.200 

.071 


Voi’iklnilnry 

.M 

•IH 

.221) 

,002 



1' 

:i.'i 

.317 

.100 

0.05 


in,til 

h:i 

.201 

.()7-l 



Hc.on*^! on llio work wnaiiln than lli« fiirlH imcl tlii.H did not occur 
on any cilhcv Icsl, a;! can In; .'mtii from an uxamhiaLion of Tablo 2. The 
crilical nilio was 1.15 fur Ihn work nainplo and below 1,0 for each of the 
oUuT to,sis (dvcll. 

In onloi' 111 Irsl the <‘nVel, <if (lilTia'eneofl in exiieriftiice botwceii tlie 
inulf'.s and foiaaic.s, dala on llu* liackKrouiui of uneh finljjcct wove com- 
pilisl. The thit a wrif avallalile from seliool roeords, us well ua from work 
lii.sLorie.s and uinsaiiils of lioblmi.s iilroady obtained from the individuals 
by (lie ciMiTiKidor.s. Tlio rejilios to the (juestiuns, “What liuve you done 
before tliat is like this?" and “Have you done any sliopwork in school, 
re])aii work around IIm' lanisc*, or a car?" asked at the do,sc of testing, 
al,s() gave infniinal itni about experience. 

'L'lie d(‘gre(i iif exjMTieiice was rated ns none, little or some. Those 
ruled as “iinnc’’ liad no expericnee at all or only woodworking in dcmcn- 
tavy Hchool. 'l'lie hitler wiiH Ihe laise experience for the inale.s. “Little’' 
exi)ei'ieiu',(i wii.s deliiKMl as oeeusioiial minor ixipuirs at home or as a hobby, 
irsually nderred (o as “lixing thing,s”; or two shop courses, not including 
eleetridly; or a sliorL time (approximalely three mouth,s) experience in iv 
factory, 'Dk! (uitcria for ''Home” cx])erience were two or more shop 
courses other tlnui woodworking; much and more cxtciLsive home or 





18 


Marion Sleel, Bcrtj. /Iwhnsfrj/, 


Table 2 

Meana, Standard Dcvinlions and Criliciil llnlUMi IlnUvrHi SV\ni 


Test 

Sex 

N. 

M. 

S.l). 

(Ml, 

Finger Dexterity 

M 

F 

40 

36 

H.tK) 

0.03 

l.r.Ci 

1.07 

O.IUI 


Doth 

84 

3.0,1 mill. 

1.41 


Tweezer Dexterity 

M 

40 

0.1.1 

n.{i;i 

0.1 :i2 

F 

36 

O.ifl 

1.11 


Both 

84 

(i.I7 mill. 

(1.91 


Placing 

M 

40 

239.18 

21,12 


F 

36 

212.20 

2o.ir> 

n.os;) 


Doth 

M 

210.48«t. 



Turning 

M 

49 

IW.IO 

20.20 


F 

36 

m.M 

2\.19 

0.305 


Doth 

84 

190.52 MC. 

22.05 


Minnesota Spatial 

M 

49 

0.00 

2,IK 


Itelatvons 

F 

36 

0.80 

I.H2 

O.KOO 


Doth 

84 

0.00 min. 

[.90 


Vocabulary 

M 

48 

05.l)ri 




P 

35 

C8.80 

l.l.Tl) 

0,700 


Both 

83 

07.14 

11.1(1 


Bell iind Battery 

M 

40 

11.70 

4.50 



F 

35 

10.0-1 

,1.70 

-1.16 


Botli 

S-l 

13.81 min. 

-I.OJ 



hobby experioTvoe; or an electrical shop co\irscau(l at IcusLom* t^lbov hIioj) 
course; or finally three different shop eour.sos, not iinslnilinK olimlvlrity. 

Examination of Table 3 indicatcH a conmaUjiil lr(*H(l for LliostJ \vill» 
more experience to complete the work sample in titm?. Api»ai('nl)y 
experience is reflected in the time scores. Jlhim imd ('iindcvi, in Die h( inly 
referred to above, found that experience was a factor in i nisiiif; tin* scori's 
on testa requiring the handling of concrete imitoriiils, Hpceificnily the 
placing, turning, and finger dexterity tests. They wrote, "ApparcuHy 


Table 3 

Amount of Experience, Median Time Scores, and Inlcrciunrlilo IIivuk'’ 
Each Sdx on Work Sain])(o 


3 for 


Experience 


None 

Little 

Some 


Sex 


No, 


Mediun Tiiiio 


M 

r 

M 

F 

M 

F 


20 

24 

8 

6 

20 

S 


12' 30" 

2' 20" 

18' 

3' If)" 

10' 30" 

4' 00" 

17' 

3' 3K" 

0' 50" 

1' 48" 

0' 16" 

38" 
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A on t/ifi Utir, of a Work iHiwiph 

cxperiniUM! in wrup|iinf^ rlcu's have a cITect in raining test scores on 
three (lifTeront Ui.sfs and in niduciiig initial differences unnmg the workers 
on tlie It'Hls," 

To lest (nianliLatively the relative "intorestingness" of the work 
sample, and the ol,lier teslfl, t)ie ruiestioii "Wliieli of those tests did yon 
like hest?’' was asked. 'J'lie oximriinenlul groups liad been divided into 
Gronj) vV and (Ironji Ik (ironp A bad Ihe dexterities first, Group 13 tlio 
work snmple first, In (tronp A, 20 of the iimles and 11 of the females 
liked Die n'ork Kamjdo lie.st; 2 of Die ninh'.sttnd 4 nf the female,s liked one 
of till! dexleritii'H liest, im<i 4 of the males and 1 of tlie females had no 
particular prefereiUKo Giie girl of the 17 giiis in the A grou]) refused to 
complete the work Kample. In Group 11 18 of the males and 12 of the 
females liked Ihn work sample. IiohL, 3 of the nmles and 5 of the females 
liked one. of tlu'. (lexU'.rities ijp.st, and 1 of the fcinalos had no particular 
preference. One girl of the 19 girls in Group 13 refii.sed to complete the 
work sainiilc!. For Lin* total mule group, the atandavcl error of the differ¬ 
ence. between tlie ixt cent liking the work niimplc best and tlie per cent 
not liking tbo worlc Hiiinple l)eHt was 7.7. Tliifi diffcsrenco is significant. 
For the total feinaki group, the Htaiulard eiTor of the difference is 2.6. 
TIji.s n’ould mean tliat the (]lian<;o.s are about 9 in lOOO Dint the difference 
is a clianee dirference rlue to mimpling. 


Table 4 

Niifiiher of AfiiovorK to Q«e.q{ioii, "Wliich of TJicto Tc.sffl Did You Like Ucafc?” 


I.ikcd Hc.hL* 

Group A 

Group B 

Total 

s 

V 

M 

F 

M 

F 



11 

la 

12 

38 

23 




3 

5 

5 

0 



■1 

0 

1 

4 

2 


* Olio foimdo eiioh in Gremps A nud IJ rtfiiHcd to complete the worlc acimplc. 


Anotlier quc.stion, “Which Avas easiest for you?" wn,s also asked. In 
Group A, only 11 of the nmica and 4 of the females said that they found 
the work sample easier, 12 of the nialca and 12 of the females said that 
they found one of tlie dexterities oaHier, and 3 of the nudes and 1 of the 
fmiiidos said no one teat wins easier tluiu another. In Group 13, only 8 
of tlic: malfss ami 2 of the fnnnilc.s indionted Unit the work stimplc ayus 
( uisier, U) of the males and 12 of Die females found one of the dexterities 
easier and 3 of the nialc.s and 5 of the fomales said no one le.st \Ya.s easier. 
Fvidently the greater degree of interest in the work sample was not due 
to the fact that it ivaa easier than the other tests. 
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Some examples of repiies to the question «-hy fhe ^vn^k uj.s 

liked followi "TMb is more like real work, Init mv lilu! (•liild « 

play" “Juab liked ji Get aomothing oAit of it, Hu* Htuiul.” “Mmh; 
something, know it’s finished. It works. Komotliing 1 miolo." “lliis 

more sense to it.” 


Table 5 

Number of Amwera to Question. ‘'Wliioh \\'n« V'n'dr-I. f'T Ynu?" 



Grou|) A 

Croii]) II 

Tnlil 

Easiest Test 

M K 

M f 

M r 

1. Work Sample 

11 4 

S 2 

I'.l 0 

2. A Dexterity Test 

12 12 

10 12 

22 21 

3, NoithorKind 

3 1 

3 f) 

IV 0 


Tentative ConcluHi<mH 

The following conclusions can be drawn from Ihia i>yulimiusu-y Hlmb,'. 

1. The work gamplc had low correlations with U\(‘- »h'Xtvi'i(.v N'wls, 
This might be intorproted to menu that the work wiunplo wiia Jiii'iisurni); 
functions different from those mcaaiircd by the I'ingcr and ’ru'('(’Z(’r 
Dexterity tests and by the Placing und Tnrniiig IchIh. 

2. A significant sex difference was obtainc<l on the. work huio) for 
the group used in this study. Tliia 8C.x differcncjs jmi.st lai coMfiidi'Vcd an 
preliminary and might possibly be attributed to (lifl’ordncca in d(*gi‘i‘a !U.d 
kind of experiences had by the males and females in fbin wunpJing, 

3. The amount of experience wan related to the tin\o. lakeu (tv (‘.inu- 
plete the work sample. Those with “Home” oxporioneo eomplcli'd Ibt' 
work unit in less time than those with “little" or “nono." 

4. The work sample was liked best by moat individimlH (I'shid, bollj 
male and female, although a greater percentage found it more dillii'ult 
than the dexterity tests. 


Becommendabions 

Qualitative descriptions of the performance on the uvnlc Kamplo 
valuable information to the vocational coiiUHelorH. Tim tlcKcrijdidiifi 
■were in terms of work habits and nttitudcfj, facility in iuLudiiiig Uhi I-hiN 
and material, initial adjustment to the task and the vmudinn tn dilli- 
culties. The examiners had checked each other for rclinlfilil-y of Ihn 
qualitative description. However, in order to mako the worJc .siiinplc 
more applicable to an industrial situation, it is thought neccHKary tu have 
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lli(( flci'criptiiHifi clicdnl by quivlilicd pooplo in industty 

in ^^oI■k it*’, fni' insliLtici!, lhal, of ficdtrical assembly. 

'I’Ik! liiiu- I'Cnrc tm | bf work .sample hIho neeclH validiition if the sample 
is to Im' icliitnd III HiiTi'r-s Oil iL job. It is pvopofied that the work sample 
1)C (I'ital out in nlinpn, MUeb im riuli(» or (deetneal assembly, where 

sliop foirmiin lalini'ii wmihl iir. iivaiiiiblo. TIkj nithigs could then be 
(iDinpnri’il with Ww (iiiK? M'nri' to le.st Uhj vulidiiy of lh(3 time score. 

//rriiid/ ill./:). 



A Method of Objectively Measuring Shop Performance * 
Marlon White McPherson 

TKaj/pe County TramlnySchwl, 7/orihwtlc, Afir/iipim 

The need for aome device for the dingnoaia of trniiuibilily and for (lie 
refined evaluation of achievement in wood shop work in well known. 
A survey of the literature reveals few objective meiifiiiroa of ptirfoniuuKKi 
in this area. In tlieir study for the Committee on Iluniun Mif;ialioii 
the Minnesota group* used actual shop perfonniinco to (leleirnine Iho 
validity of their testa. The ideafor the compilation of our test originiitod 
from the methods they used. It was possible tliat their toelmitino could 
be developed into a shortj convenient cvnlvi&tbn and thereby \\w\n\ Ibviv 
criteria for the validity of a teat the actual perforiunnee U) inc.uHiivtut. 
Therefore, we have begun an investigation of tlu? pvactioidity of Hiieli a 
direct measurement and of its sensitivity to continued wood nliop experi¬ 
ence. Refined data regarding the reliability and tli(i pro^noslic vi\.\m of 
this device, once developed, are matters for furllier rosciirfth. 

For the copying of a model wood block to con,4titnL<‘ n Hutisfaetory 
measure of wood shop achievement, it must l)o annuniblo t(^ objee-livo 
scoring and it must include as many as po.saiblc of tlie basin uelivifiiis. 
To detenoitie these We were assisted by our Wood Bbop teaoherrt ^ Hineo 
they were able, out of their experience, to identify the iminnlant oi)i‘i a- 
tiona and the preoision which our mentally defective \n>))ul»iiou inij^bt 
be expected to achieve, Work with at least the saw, drill and clur^o,! 
should be included. The product should l)o scored with /(‘Hpwit to 
accuracy of dimensions, angles, and locations; to rnetliocl of d(!t(!VJniiiii" 
tion of positions of operation; and to neatness of execution. In iidditioii, 
the convenience of the device would be increased could the .sampling bo 
integrated into a single piece of wood. All of tliese con.siderations 
entered into the construction of the model. 

♦From the Wayne County Training School, Hobart If. Ilrwkoll, M.D., Mcdit’nl 
Superintendent, Nortbvhlo, Michigan, Studies in the PflyohopntlioloKy of Cliildlioinl 
and Mental Deficiency, supported by a grant horn the McGregor Fimd, 1 )cilr()iL, Mubi- 
gan. Report No. 65. Tfio nchiovoment mensuroments dcficiibcd ui UiIh iiupor wi'id 
devised by A. A. Strauss, Z. P, Iloaldoy, and L. C. Sullivan. 

'Paterson, D. G., and Elliott, R, M., et nl., Mintiesola mcchunical abilHi/ tentft. 
Minneapolis: The Univaraity of Minnesota Presa, 1030, 

'We wish to express our appreciation to Mr. Edmund Crosby nud Mr. Normtiu 
Running. 
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In order to assure uniformity of approacli the model "was presented 
in four consecutive stages of completion. Each of the four blocks was 
10 inches long, inches wide, and ^ inch thick. The first block was 
a plain board, cut to cortain dimensions; the second had the hole drilled 
in the left side; the third had the above and also the central groove; and 
tlie fourth was the coinplotcd block. TJicae blocks, in a left to right 
progi'fisflion, ■were hung on the wall in front of the subject but beyond 
his reach. 

To insure objective evaluation, a scoring pattern was developed. 
This consisted of an outline of the model, drawn on a sheet of transparent 
plastic, tlint could be superimposed on the subject’s completed block. 
Ill addition to the outline of the pattern, lines were drawn at uniform 
intervals to indicate the dcgi’ces of deviation of the product from the 
model. The appropriateness of the intervals was determined by the 
precision which, with training, these children might be expected to 
achieve. For example, lines were placed at each one-eighth inch interval 
for a reasonable distance at cither eide of the lines marking the correct 
length of the board. The lino marking each correct position was assigned 
n definite value which was reduced by one point for each unit of deviation. 
That is, a block of the correct length was scored 10; one that was one 
unit (H'l either too short or too long scored 0; one that deviated in either 
direction by as much ns two units (14") received a credit of 7, etc. 

In an attempt to determine the fcn-sibility of measuring and scoring 
performance with the method outlined in the preceding paragraphs, the 
model was prcfioiilcd to fifty-nine boys of tlio Wayne County Training 
School who were enrolled in the wood shop course in the academic year 
1940-41. As enrollment in this shop is a part of the natural sequonco of 
the training program for boys, Ihcro were no known extraneous factors 
operative in the selection of aul)jects. All were in their thirteenth year. 
The mean Biiiet P.C.' was 86.49, S.D. 6.31; the Arthur Performance P.C. 
89,93, S.D. 0.78. 

One boy at a time was admitted to an enclosure of approximately 
10 by 40 feet which had been partitioned off at the end of our wood shop. 
Hero he had accc.ss to a variety of tools including different sizes of chisels, 
eaws, drills and, of course, the correct implements for the assigned task. 
He was given a board of the width and thicknesa of the models but at 
least oru; yard in lengtli and was told to make his board look first like 
the one luinging in front of him at the extreme left, then like Llie second, 
then like the third, and finally like tlm one at the oxtiemo right. No 

* Ilildoii, A., Table oj Hcinia personal amalanl ealuea. Minneapolis: Eclucationfll 
Test Bureau, lt)33. 
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more specific instructions were given. He wns allowed to work wiLiiout 
time limit and with only caeual adult miperviston. 

One semester later fourteen of the aubjecte were again prosoiitcd witli 
the problem of reproducing the model. This wa.s done iu (trder to incus- 
ure the change in score which would result from attaiidanco in tho wood 
shop for two hours per day during the half year. 

When the subjects had completed their blocks, ii Icclmiiiuo for (luiui- 
tifying the performance was developed.^ Jilacli raw scon* was niulliplicil 
by certain numbers ranging from 1 to G depending iijitin the judgcid 
difficulty of the task and the number of times the piirticuliir opcriitifjn 
was scored. Neatness and method of dctcvininalion of posil ion of opera¬ 
tion were evaluated on a point scale. TJic number of int;er\’iilM on tho 
scale was determined by the units that gave the best iipproxirniiLion of 
a normal probability curve. The total po-ssiblo score of 300, (livklerl by 
3, left a maximum score convenient to treat and .su/lhiicntly large to 
express fine gradations of skill. 

That our scoring method is reliable is indicated I)y the I'esults of a 
brief study. After eight months of no contact witJi tliis rosoiirc.h tho 
psyohometrician, who originally scored the boards, re.scored them. Al¬ 
though 82 readings are required on eacli of the 50 boiu'cls Ukj Ihiiu'siin 
product moment coefficient of correlation between the two scoringH was 
+.97, ifc.Ol. 


Tabic 1 

The Means and Standard Doviablons of tho Itaw Scores 
meet Meaeurementa Obtained by Iho Entire Group 

on tlifi Wont) Kliftp Acliiiivo- 
ninl tho Traijiing (!r(ju|) 


First Scoring 

iSeiiDtul Sdoriiig 


Number 

of Doya Mean S.D. 

Nuinlier 

of Hoys Mean S.f), 

Entire group 
Training group 

59 60.51 14.05 

14 65.03* 16.52 

14 70.02* Ui.oo 

Fighor B i for related meaaurea - 4.42, BJEmficant at the 1% lovcl. 


Table 1 indicates the mean and standard deviation of 11 .,, m 

... 

ho. C. H, CO.P.O,, 42. N. 
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would be found Ig.sh than one per cent of the time if the means did not 
differ significanbly from zero, 

A Pearson product moment coclHcient of correlation betAveen the raAv 
scores for tJio 5!) Hul>ioRta and tlieir Bind ratings Aras found to bo +.43, 
eignificaiit at the one per cent levclj a similar coefficient betAveen these 
viiluGH and the. Ai thur ratings was found to be +.51, significant at the 
one per cent level. 


Table 2 

Tlio Amount of CluiiiRn in Score.s Dutwcon tho Firat MoMuroment and the Ono 
Following TrnininB in tlic Wood Shop (14 indiviclualB) 


Aiiiutiiib of Change 

Frequency 

-11 to - 7 

\* 

- 0 k) - 2 

1* 

— 1 to "h 3 

0 

-f- *1 to “h 8 

2 

-|- D to H-13 

3 

-l-U to+18 

0 

H-U) to +23 

2 

+24 to +28 

3 

+20 to +33 

2 

T= 14 

Moan; +15 


• Coii.HidoriiiR tlio iimtiibilily of a number of our clnldron fclio two training score 
(l(!crniiicut,s nro not niiuxpcotod. 


The distribution of the raw bcotcs and the retest gains for our group 
indicate Hint ilu! teclmiciue hits value. The application of this measure 
to u iKii'iual f)V superior population may dcioanrl changes in the precision 
units and the establishiucnt of norms suitable to that group. Thorough 
iiivestigiitiDii of this techiiicpie involves control of academic subject 
iicliicA'ciueiit, pre-.scliool shop experience in Avood Avork, verbal or non¬ 
verbal superiority,'race, bilingualism, etc. 

Measurements for Mctal^hop 

Tli(‘ AA'ood-shop study Ims iiidicatod that an jwiiivity can be ineiisured 
dii(!(;(.ly wilJioiit th<! noccHsity of evaluating performance tlirougii tlic use 
of lesis tlial incndy Hamido behavior. Tlicrc Is no o priori rcn.'.on Aviiy 
such a l,(;(‘liiii(|ue (amid not ho c-xLciidcd to meet tiic needs of oLli(ir shop 
activilie?', for i'X5Ui\]do, tlrose of a metal shop. 

To iiivo.stigatc Lliis, another staff conference av'jls held, d’he impoi- 
tiuiL acLiviti(!.H in the metal shop Arorc isolated, their leluLive difficulty 
detenniued, and the precision Avliich our children might be expected to 
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attain identified. Inapection of the work sample cvaluakHl in tin* Minno- 
gota study (1) did not reveal any one product that would aainplo many 
activities as we desired, Consequently, we dcveIfli)Gd four pattorn.s, the 
reproduction of which necessitates wire bonding, sheet motnl soldering, 
riveting, locked seaming, wiring, and circular and angular cutting, 

Thirty-three i4-yeav-oId boys were asked to reproduce the model. 
Only the tools necessary for the task were present and nil tins p!iLL(H'n.s 
were accessible throughout the reproduction. In this situation the 
measurement is one of the efficiency of the use of tools and does not in¬ 
volve their selection. No specific instructions were given to the subjoets. 

The scoring pattern is of the same type as that used in the wood-.sho]) 
study. It can be superimposed over the bent wire, the cut pattern, and 
the folded motal. Although we have been able to give but superficial 
study to this device, we have compiled the manual and scoring koy as a 
means of presenting in detail the important oporntion.s that are atnonablo 
to objective rating, 

RecM Fehruary It, 19U. 



An Analysis of Absenteeism in One War Plant 

Neul G. Schenet 

Natioml Wnlch Company, Elgin, Illinois 

To say iliat iih.sc'ninoiKin ia of prime importance in iridngtry today and 
that it ia one of the larReat probloma to be faced on the homo front ia 
redundiint. The mere fact that the pcraoniiel man in industry now ia 
coiifi'onted witli the aubjcct wherever he turns, in nrticlca and on the air, 
as well as in the j)lant, ia proof enough. 

It will be the ])urpo.se of the pro.seiit study to determine the nature 
and extent of absenteihsin in a typical war production plant with special 
rcforcncc to tlie individual and the collective effects of age, sex, and 
length of company sorviee. Sex diffcrcutials are always an obvious start¬ 
ing point, and a revimv of the literature on the 9ul)ject shows that ago 
anil length of company service would be of interest also. Almost any 
other diffcrcntiid noiild have been used, such ns physical characteristics, 
inUdliKcnce test scores, etc., but these appear, at least on the surface, to 
have little I'clatioiiship the total problem. This led to the choice of 
the viina))les used in the present study, 

Ilcvicw of the Literature 

III reviewing ilic available literature on absenteeism, it was found to 
fall gonci-iilly into three (5liiHse.s; namely, data on causes, discussion of 
records and methods of study, and auggestions aa to remedies, 

Most of the aiticlcs luive been unscientific in tlicir approacli, omitting 
all or nearly all statistic.'? on the subject, making only broad generaliza¬ 
tions, and usually being on a speculative, rather than on a practical level. 
Estimates, in these writings, ns to the number of hours lost, types of 
absences, etc,, vary widely. Bearing this out, one governmental source 
states, "There is no statistical information available to indicate the 
general extent of ahRcntccism iu the war industries. Scattered reports 
from a numlxir of factories reflect rates ranging from between two and 
three per cent to (ifteeii per cent or more” (11:2). Certain general 
ehai'/ieteristics of absenteeism, as given l)y several govornmenial reports, 
may be meniioued, One source states that . alwcutccisin rates arc 
geiioriilly higher for women than for men, even on jobs of the ,saino gen¬ 
eral character. . . . Greater sickness rate.s among women arc probably ii 
factor in their higher ab.seiicc rates . . (11:2). 

27 



28 


lieal G- ^cftcnci 


On n basis of compariaon of mole and femalo ratoH wo learn, "One 
large war plant reports current absonce rates at 4.8 per cent for men and 
7 4, per cent for women. . . ■ These figures arc typical of. a number of 
reports" (11:2). Age may be a factor of imporbaiice ainco "a study 
undertaken by one company indicates that absontonism tends to be 
higher among older workers, increasing rapidly after forty or fifty years 
of age" (11:3). 

There seems to be a series of effects which cause a tondonoy for 
absences to be numerous on days Bdiocent to a week-end or holiday, 
"These effects frequently combine to produce . . . the liighcst (rate of 
the week) on Saturday" (11:3). 

Absence figures appear to indicate that offices, tool cribs, and super¬ 
vision show lower rates than factory work generally. There is, how¬ 
ever, no information available, to the writer’s knowledge, to iiidicato 
whether absences tend to be relatively more frequent on routine m com¬ 
pared with nonroutine work, or on heavy versus light work. 

The definition of absenteeism suggested by the United States De¬ 
partment of Labor, and used throughout this paper, is as follows: "Ab¬ 
senteeism is the absence of a worker during a full shift that he is scheduled 
to work" (11:1). 

In conclusion, as far as the writer could determine from going through 
the literature, very little work has been done in the field of causes of 
absenteeism, or more specifically, in the field of the (jflfect.s of certain 
variables upon the total field of absences and absontceiHin, 

Materials and Methods 

In order to make a meaningful and scientific STirvoy of the problem 
and yet to keep it within reasonable limits as to size and scope, it wim 
decided to break the absence figures down by (1) age group,s, (2) length 
of company service groups, and (3) sex groups. 

For the purposes of this investigation it was decided that one of the 
plants of the Elgin National Watch Company, by which the writer ia 
employed, be used because of comparative ease of acccas to ub.senco 
records, familiarity of the writer with the plant and its pcrHonnel, and 
size of the plant. The plant chosen was Company Plant No. 2, manu¬ 
facturing a mechanical time fuae for the armed forces. This work is of 
a fine, precision nature, requiring in general a higher typo of omployeo 
than the average factory. The plant has an average labor force of 
approximately 860 to 900, with about 65% women and 36% men. The 
regulation work week at present is six oighb-hour days, with Saturday 
an overtime day and not, in the post history of the company, normally 
a working day. 
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Tlic period of study used waa the first four months of 1943: January, 
February, March, and April. The days of the week studied were Mon¬ 
day, Tuesday, Wednesday, Thursday and Friday. Saturday was omitted 
specifically because of the fact that absences on this day become of 
importance in and of themselves for ccitam very definite reasons. For 
example, Saturday is the last day of the week and fatigue will enter into 
the situation; also, Saturday is normally an overtime day and as auch 
U cQuaidcrcd as "different” by the average employee. The writer found, 
merely by inspection, that these statements are true in this plant as 
shown by tlie unusually high number of absences for this day in propor¬ 
tion to all others. It was felt, os a result of these observations, that 
Saturdays aliould be removed from the study, and if surveyed at all, 
should be the subject of a further, separate study. 

The age groups chosen wmi'c (1) thirty years of age and under, (2) 
between thirty and forty years of age, ond (3) over forty years of age. 
The lengtli of company service groups chosen were (1) three months and 
under, (2) three to six months, and (3) ovct six months. Subsequently, 
it was found that the length of company service groups were somewhat 
out of line, l)cing weighted on the aide of longest service. Thus, the 
probable error of rcsulla found in some of the service groups will be larger 
than if the ca.se3 had been more evenly divided. However, in spite of 
this skewed distribution, the facts obtaining in the small groups appear 
to corroborate reasonably well those in the larger groups. 

In dctoi'inining which atatifltias to use, it was decided to use the 
number of days lest and also, to disregard any absences under one day 
in length, This last decision was made because of tlie labor of handling 
the data and because, upon in-spection, the basic facts appeared to hold 
true i‘cgardlcs,s of the length of the absence. "It is . . . difficult (and 
u.simlly unncce.s.sary) to tabulate part-day absences and there is, for 
example, no obvious line of demarcation between part-day absenteeism 
and tardiness" (H: 1). 

Individuals used as subjects in the suiwey were classified as to age 
and length of company service at the beginning of the period; that is, 
on January 1, 19'13. Because of a possible error introduced by employees 
entering and leaving the sewicc of the company during the period, it 
was determined to use only Ihoso individmila who remained active in one 
specific department of tl\e plant during the course of the study, The 
total number of subjects obtained in this mojincr wa,s 750; 280 men mid 
4.70 women. 

The goneral inetliod used in obtaining the raw data was to use the 
figures on the comininy's "Daily Time Exception Sheet," which is made 
out by each department and turned in to the Payroll Department daily. 



30 


Neal G. Scheiiet 


On these sheets, only those absences listed ns ".T' (Sieknoss) “WP" 
(Without Permission), and “TR" (Time Requested) were used, all others 
(Plant Accident, Vacation, etc.) being omitted ns not ])ertincnt to the 
survey In compiling these statiatica and tliroiiRbout the sLudy, WP 
and TR have been combined into one group which will he refeiTcd to 

as “P" (Personal). ... , , t* 

A brief word of explanation for this procedure m in order hero, be¬ 
cause of the method of maTking absentees iu this plant, it is fc.lt that 
both WP and TR actually contain a great deal of each oLIkm* and .should 
not, under the present conditions, be separated for tlio purpose's of ibis 
study. Absences are reported either by tclcpliono, by a friend ()r the 
absentee, or in person when the absentee returns to ^vork. As a ro.sult 
of this, if a person called his department and stated, "I will 1)(3 absent 
today because I am going to see the doctor," one departnunit may class 
it as WP because no prior permission was obtained, while aiiotliei’ de¬ 
partment may class it as TR merely because the pDrHt>\\ was kind enouRh 
to telephone and not leave them In doubt. Tliis procedure ha.s boon 
verified by the writer in personal convorsatioiw witli the varioiiH de))art- 
ment heads. Since we cannot separate those inlangilde amountH of WP 
in the TR heading it appeors more logical to group tlioin iogeiiior. 

No attempt was made to show the duration of tlio ab.sence.s, oacli 
full-day absence being listed as a separate item regardless of wliotiior or 
not it appeared in connection with other full-day alj.soncoH. I'luit is, 
while we may know how many full days an individual was ab.sent during 
the calendar month, it was not recorded wUellicv or not thcisn tlaya 
absent were scattered throughout the month or localized iu one long 
absence. 

When this master list of absences was completed it wjw jmssildo to 
obtain the number of days lost for sickness and porstnial reaHons by 
department, sex, age, length of service, or by any one or more of tbo.se 
variables without regard for the others. Distribution of tlio data by 
these groups was facilitated by entering the pertinent facts upon a .sorios 
of index cards, one for each employee in the survey. Theso cards tlion 
contained (1) the name and department of the cmjiloyee, (2) tbo ago 
group of the employee, (3) the length of company sorvieo groui) of tbo 
employee, and (4) all absences listed for the cmployco brolccjii down by 
calendar month as well as reason for aRscncc. Tlio.se oards woro Llion 
distributed by the groups listed above. 

The absence figures were then used to calculate the ubKonco rates, by 

means of the following formula; Entc = "f d i^sJlosl2)y group 

Number of por.soiiH in grou]) 

By means of this calculation it is now possible to compare any group 
with any other group or combinations of groups, since we are dealing 
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in rntca rather than raw data. Also, in oi-dcr to provide a basis for 
companson with other sets of statistics, both national and local, the 
al)Rent(‘eiHin rates l)y mcji and women for the entire four month period 
wore fiRurcd UirouRli the »ihc of the following formula, suggested and 
used by the ]iur('au of Lal)or Statistics: 


AhHeiiLeeiHin l{at(^ = 


Man-days lost X lOQ 
Miiu-days scheduled to work 


Man-days Helnidiiled to work = Number of persons in group X 86, 

the number of work days involved 
in the study. 


There may bo some question as to the use of two different formulas 
for eomijutiiig aiisenee rates. The reason for using the first formula is 
to simi)lify the labor involved, since the second formula requires an addi¬ 
tional compulation. It is not necessary to have the rates computed by 
tliG Bureau of Lalnir Statistics formula in all the individual groupings, 
binco there is luj method of checking and comparing sucli figures wth 
national or area rates. There obviously is a one-to-one correspondence 
l)etWRcn tlio writer's fornuila multiplied by 100/86 and the Bureau of 
Labor Statistics formula. 

Upon in.spoctinu of the data, several differences appeared to be out¬ 
standing, and ill order to determine whether they were significant and 
real difToronccs or wlicthcr they might easily have occurred due to chance, 
standard deviations of certain of tliese items were computed. From 
those, critical ratio.s wore determined, and results will be discussed later 
in this paper. 

Results and Discussion 

In a diHcuH.sion of tlic results of the pre-sent study, it would be most 
pertinent to begin witli the field of sex differentials in total and proceed 
from there to the differences within each group and the age and service 
differences wliich appear to stand out upon inspection of the data. 

The most strilciiig fact is that the female rates are proportionately 
much greater in almost every group than the male rates. This appears 
true ilirougliout tlie entire Plant, in all departments, service groups, age 
group.s, and totals, In total ab.sciiccs in all departments the female rate 
is exactly Llircc times the male rate, that for men being 1,3 while that 
for women is 3,9. For sicknesH alwcnccs the rate for women is twice the 
male rate (1,9 and 0,7). In pcnsoiial al)sciicc.s the clifTcrence is even 
greater, the female rate being between tlircc and four times that of the 
men (2.0 and 0.6). (It will be recalled that all rate.s may be thought of 
as "average number of days lost per employee.") While these results 
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Absence Rates for Male Employees in Four Largest Departments and for Total of All Departments Included in the 
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are in line generally with those obtiiincd in dllior HiiwIioM il, would 
that the differences are even more proiio\nicod. 

A statistical investigation of these results yirlds, in the ciisc. of male 
totals versus female totals, a crilicnl ratio of S.fi, iiidioaliiig ii vciy Jiigh 
probability that the difference is n real and signiricanh oiie. the cane 
of male, sichness, versus female, sicknrHs, lire crilieivl ratio in ^.2, and 
it is 9.0 for male, personal, versus female, perwnuU. 

One other fact of interest is tiuit for tlio Loliil group Ok? .siekiie.-:,'! and 
personal absences arc about evenly divnled, the foruuU' acemiiiling fur 
49% of the total and the latter for 51%. This in at vaiianre willi a 
statement made by Spriegcl and Schulz that "In a nLiidy of I0,()()0 em¬ 
ployees of both sexes it was found that the causes of llieir ab.smices wen; 
40% due to sickness and accident and C0% duo to ixasonal i‘t;asonH'' 
(10;164:). However, this may also be due to a <iiftev<‘n<'e ui detinitious. 

In the field solely of male rates, certain fnetom appear l<i he of Inf (‘rest, 
The rates for sickness and personal ahscnces arc approximately tiu; same, 
being 0.7 and 0.6, respectively, showing u fairly even (lislril)Ulh)n of 
absences on this basis. Of the length of company .service groups, (irouj) 
Three, or Over Six Months, appears to be the liighesl, espeeiidlN’ fi'oin 
the standpoint of sickness absences. This would hav(‘ no ai)iuuenl I'x- 
planation other than the possible foot that as length of service, iuereases, 
more adherence to the rules of reporting ftb.senae.s follow.s, wliieli would 
lead to classifying many absences as Nicknc.s.s which would (jLlmrwi.sd he 
classed as personal absences, because of not being r<;po)'t(!il. 'J'lu' erilieal 
ratio here for men with more than six mouths .snrvi(!(i vemuM u ifh 
zero to six months service (groups combined bccauso of Ok; .small niimher 
of cases in each) is 4.1. 

The age groups of the men do not appear to ho. i vlutod signilicuudy 
to absence rates. Group Two, thirty to forty yoais of ago, i.s slighlly 
lower in sickness absence rates, but not appreciably' so. Tlii.s .sctiin.s (,o 
be at variance with the statement made by Walkiii.s and Dodd that, 
". . . the time lost by male workers below the age of foity on a(!(;ouiit 
of illness tends to be lower than the average mnle di.sabilil.y, hul hoyond 
forty, males show a rapidly increasing morbiiUly riUo" (iriPiOli). 'Platy 
also state elsewhere, "Experience indicates that yimUdvil mnidnyai's are 
more careless in the matter of punctuality and atleiuliimw than ain. luorr 
mature workers” (15:265). While this may he true in g.moral, tlm 
present study does pot seem to show this to any great degron in thi.s 
particular plant. The fact that these findings do not agree entii'(‘ly w il h 
the rmlts of other studies maybe duo to certain special faetois ol)laitiiiig 
in this specific plant. However, it is evident that the re.suU.s arc sliowing 
a general trend toward agreement, since both the younger ami (dder 
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\v<)rki‘)>5 !ir(^ in rate Ihsm llio intormediate group, as fur as 

mckncHs iihsoiicrs iin! concornwl. 

Iti tlu‘ licM r)f fciiifiln rates, it is niipurRiit that liorc too, the sickness 
ami peiHoniil alisi-nons mo. apiiroximiilely the snine, the rates being L9 
and 2,0 nisinn',lively. Ilnrn, hiAvoYor, Service Group Two, tlirco to six 
montlifi, is liighesl in ntte, being l.l higlnsr than the next group and l.G 
higher l.iuiii ilie lowest. 'Pliere appears In be no logical explanation for 
this unU'HS, as the wiitev feelH, there is a pericjil of orientation during 
which th(! luav workiT Lends In be c|uite regular in attendance, followed 
by a period of l.-ixil >’ in repurLing alwenee.s, eiiused, pcrhai)3, by increasing 
fainiliiuity with tli(^ plant, aflcr which there ia a lajwe into a somewhat 
steady groove; of ('oopcriilioii. I'roin the statistical standpoint, this 
(lilTeronce is not as .^ignilieant as some othens, for the critical ratio in the 
case of women with three to six inonlli.s service versus women with over 
Hi.v nionlli.s ,s(ii \'ie(; is only I.'l. However, (5vcn this critical ratio indicates 
a probability of .!)2 lluit the dilTerenec Ls real. 

Age gi't]up on(‘, 3(1 and uikUt, is no liighcr than the other groups, 
Homcwliat naan.-^ing llio liuding.s of Wiibkins and Dodd from the stand- 
])()iui of the incrcasetl tdiseubieisni of younger workers. However, age 
group thr(‘(‘, dver 40, is slightly liiglier than tlie ottier groups, bearing 
out their .slatmiient, “In the ea.se of feiiiale employce.s the rate remains 
le.v.H than tin; MVC‘rag(“ U}) to age Uiiiiy, but increases beyond that point" 
{ir);2r)()), III the fionnUi rales, tin; sendee gn)\i\>s show more variation 
Lliun do the age gnm|i.s, as in the ease of the male rates, kuiding to point 
to the fuel that length of .serviee is more important than age. 

in the realm of deparl.mcnlal <lilVereiice.s, the oiitstaiuliiig fact is that 
I'iniil AH.sf'iiiIily lia.s more absenteeism Ihiui any oilier deiiarbincnt, of the 
four liugi'.sl oiH'.s. (In dise.ii.'^Hing ilepartmeiiial difforoncoa, only the 
largest departmenls will be u.sed, .since they contain nearly 89% of the 
total iminlier of case.**.) Tlii.s holds true in .sicknc.s.s Jind total absence 
rates, and is evident in the. rales of both men and women employees, 
althougli in llie ease of men llie rule is not nmrkeclly higher than in the 
other de|)artineii(s. In (his department the .sickness rate of both male 
and fem!d(‘ is iiiucli higher lhan in ihe other departments, wheveas rates 
of iKM-.sonal alisriicr* iiro mdy higher in the cu.sc of women, and then just 
modmately so. hi the ease of men, .sickiies.s, I’inal As.sembly versus 
iiiim, sieknee;, .Siih-.Asseinhly, the rale.s are l.l and D.-l ni-spi'clivcly, with 
a critical mlio of l.'J, indicaling SS chanees in 100 Uial the diffcreiice is 
real, Kor woiacu in the .same conipaiison, tlie rates arc 2,4 and 1.6 
nsiicclivrly, willi a eriUeiil ratio of 2.4, indicating 99 chances in 100 that 
the dinci'ciice is real. Tints, the diffcrenec for women is inorc .sigiiificiLiit 
than fur men. 



30 


Neal 0. 


Upon first glancQ this may seem iw OioiikIi tln^re i!» T^'lnlivHy more 
sickness in this department than in other«. Thin in und-Mihlcdly true, 
but along with this, tho pcraonal [tb^nm-oK, at hnuit fnr wonicii, arc- hIpo 
considerably higher than iu th« nlhcr aqKirfim'nlH, 'J'Iiim i)arli(!i,lnr 
department, having more trouble with nb.sditf'<'iHiii Uniu tlui dtluir^, 1ms 
been conducting intensive educfttimml cniu]migu^ on I lii; Hulijui-I, 'rimir 
main emphasis hna been upon the need for riiiphiyev-i hi rciuirl, their 
absences whenever posHible. Also, HLrung iniuiliv(! nicsJiiin'.'j Itavu li(ien 
instituted in this department, so Hint, for oXi>m|il(‘, Ilin’O miexmiscd 
absences bring about discharge of Ihc iibsmiliM*. Iluwcvcr, iw nhown by 
the absence rates, these praclicos have uol greatly rethu'ed the total 
problem. 

It has been the general hypothesis iu ihisdepnrlmoiil I hat llu* younger 
workers caused the majority of the nlmeiiccs hero, iliie In HiekiH'.'S, irrn- 
Bponsibility, ejpo. The rate oUarts do not bear thin oul, lunvvver, ivud, 

Qfi a matter of fact, they point out that tho younger pcmoiiH in lIiiH de¬ 
partment (particularly the women) lend lo have Inirnr nvte.s than do the 
older employees. 

It is extremely interesting, ns well ns pu7//.ling, to uoto Hud. llm ab¬ 
sence rates in general for Final Afiscmbly arc ttpi»r(M‘iably higher than 
those for other departments, in spite of tho odiicnlionul work on Llio 
subject and the disciplinary measures in effect. T)u>n^ is nolliing iijipnr- 
ent in the attitude of supervieion hero whicl\ would loml inlluoucu the 
absence rates, ond the psychological factor of working on u (ininlui(l 
product rather than a small, perhaps unrelated part, Hlioiild liiii’n a con¬ 
structive influence also. Since tho employees must ro])orl llieir ubMeJUies 
more carefully, it is possible tliat them i» a teiulvuoy for thu Hieknesrf 
absence figures to increase, for it ia much cnaicr for im ('luployco to utatc 
that he ia ill than to state that ho wants tho dny off for Hho[)ping, or a 
trip. However, this does not explain tho iucrca%d ])ersoiial ali.^oncos 
and the resultant inoreoacd totals, and there ia nolliing iu the ntudy which 
would give the answer to the unusual-Bituation obtaining hero. 

Further study of departmental differences indicates tlmt in both rnalo 
and female, the Plate Department has a higher pernonal iib.'iOTico rate, 
appreciably so in the case of women. For example, iu tho eiuny of wumen, 
Plate, personal absences versus women, Sub-iVafienibly, pcrtamnl al)- 
EenccB, the rates are 4.2 and 2.0 rcspcctiYoly, witli a ci-iLicnl ratio of h.O. 
Such a difference is not evident miywhero else in tlio (loparLnioulal 
statistics. Two factors inherent in tho depavlmonl itself liiivi; probably 
combined to cause this differonoe. Firat, tho typo of work iu Huh dopurtr 
raent is large, rough and dirty aa compared to that iu Llic oLher doparb- 
ments, and secondly, the production schedulea in this dcparLineut have 
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been fiucli Lliat Ihoro were peeks mid valleys in the amount of work 
available Lo the (‘ini]b)yec*-H. Selcdlion of employoca for this department 
RCiierally U'A to phuMnn IcsKHkillcd labor there, and sudi persons tended 
to Ik; ratiier irrr.4|)<msihlo in their ntteiidnncc records and in reporting 
their aI)H(;ncoH. Also, Hinoo iirodueUoii varied so greatly, a coidain 
amoiiiiL of rc.soiitineut and laelc of interest on the part of tho employees 
was deinctibh;, loading to higher alwontoeiam. During the period of the 
survey, a temporary lay-oJT was in progress in this dopartinent, and while 
these figures won; not included in this study, the psychological effect 
upon the n'inaiiiing employees, from the standpoint of their apparent 
need to tlie plant niul their job security, may have been reflected in their 
attciulance records. 

A brief ^\'()rd is in order from the standpoint of the total plant as 
compared to oilier plants in the same area and to national figures. In 
general, Ihc! absence rates arc very low compared to other similar plants, 
pci'liapH due to a eoneeiitriited program against absenteeism and the 
genemlly liigber type of employees, on the whole, as n result of the pre¬ 
cision quality of Ibc work. The following talilc gives the pertinent facts: 


Table 3 

I’crcenlngf; Absonco April 1013, and reroentago Women Amcng Wngo 
J'lfirnr.rs, April 1013, in Selected Industries * 


Industry 

Absence 

Rato 

Per cent of 
Women 

Amnniiiilion (Njiliniial) 

5.4 

15.8 

ICxpldsivoH (Niilional) 

3.8 

16.3 

Iiiatnuiinrit^ mid 0|)licnl J'.'qutpmcirt (Nalionnl) 

0.3 

36.6 

AH IlnporLiiig Maiiufiu^tiiring Kstablislimonts (Nnlionnl) 

0,2 


Mnniifikc.liiriiig I'lslaliliHliiiKuiU in I'Hgin, Illinois 

6.2 


Coinpniiy I’Iniil No. 2 in ICIgin, IlliiioiR 

3.42 



* Sources: Niilioiiiil Kigtircs; Iliircnu of Labor StnliBticB, U. S. Dept, of Labor. 

I'fglii Figures: Pomnnnl Survey by tho writer. 

These ligurcs are of sjiccial intcrcat mainly because of the fact that 
in Company Plant No. 2, although the percentage of women is much 
higher than in tlio other industries, tho absence rate is substantially 
lower than tlu; average. In other words, the total situation is very good 
when conijjared to l)oth area and imtionnl figures, 

Suininary and Conclusions 

In geru;r(il, a.s a result of the study, the following facts become; evident: 

1. Women luivo three times as much absenteeism as men, in total rates. 

2. Women have aiiproximately twice as much sickness absenteeism os do 
men. 
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3, Women have between three anJ four limes us mueli iicrKiiml iilisentee- 
ism as do men. 

4 It is apparent that these diffcrence.s arc tlus msulf- of Dir- sfx varuiMf', 
since they are evident in every age ftml smiee gioup aiul (Irpiul ment. 

5. In general, sickness and personal alwencps were iienrly (lividfii. 

6. Age groups show no great difference in rales, nUliougli lliere is ft sliglit 
tendency for the older employee* to be absent more. 

7. Service groups show more variation, with the nUen IrnilinK 1o iimrcasf! 
03 service increases, up to a point at about nix imuillis of .servic.'. 

8. Final Assembly Department has Uie hiBhc.st ratc.s in luilli sickm'.sH smd 
total absences of all the major departments. 

9. A striking difference is shown in the cn.se of th(! jimwoiiid ;ili.s('tic(‘,s for 
women in the Plate Department, the rate boro being much liiglu-r Hum 
in any other major department. 

In conclusion, it would seem thnt the Omlijigs of tliis study on llio 
subject of sex differentials tend to agree with ollwr similar iuvc.st igiUinns 
as reported in the literature. The age groups hIiow no londmu^v toward 
being of importance in influencing the alrsonco rales, and l)io Iciiglli of 
company service factor would appear to ho of more importuiu’ct horn 
from the standpoint of influence upon abscnleei.sni. 

Probably the moat important findings of the .study aside from llicso 
mentioned above, are in the uncovering of the two striking d('|);u'Uiii'u(.al 
difierencea, that is, Final Assembly in total fti)senUHiisin, uml l‘IuU^ in 
personal absences for women. While the results in (In) caso of Fiiml 
Assembly are not such that it is possible to give ilto answer to LIiIh jiituu- 
tion, they do serve to focus attention upon the problem ami to dinprovo 
one possible hypothesis; namely, that the younger workor.s juo ciiusing 
the majority of the absences in this department. 

Received November S, ]943. 
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Testing the Pulling Power of Advcrtiseinents by the 
Split-Run Copy Method * 

Joseph Zubia 
Columbia Cnimiii(|/ 
and 

John G. Peatman 
The City College of New York 

Many different raethodB are employed by the Advertising industry for 
the purpose of determining tlie effect of ndverti-shig co]iy on hiiIoh. One 
of the most common methods is that of "Hplitrnni copy" h'.sting. 

The method itself can be briefly degeril)cd flu one in whiidi two (or 
more) forma of a given advertisement nro priiitotl in a mnvsijaper or 
magazine of a given issue, tho advcrtiacmciils being nltmiiutcd in the 
production of the publication medium ao that tlm different forms will bo 
randomly distributed to the reading public. When pro\M‘rly e,!irried out, 
such a method should achieve the desired end of aecwriug two randomly 
selected groups of the population under atudy, oriind in nizo, ono of which 
is exposed to the first form of the advcrtifiomenl and Uui olhor to Ihc 
second form. 

The relative pulling power of each form of the coi)y in tlnui iinui.minid 
by the number of replies received. All copy tests tlii?reforo ncf’d l(i 
include an offer of eome article such as a free fiiun])lo of the i)ro(lnct or a 
souvenir. This article should be sufficiently ftttrnoti\'o to (iull fortli a 
volume of response large enough to be subjected to a slalistical t<>Ht of 
the significance of the difference in pulling power botwoeu tlio two forms 
of the advertisement. The free offer needs to he towards tho oud of 
the advertising copy and relatively inconspicuous in order to insure that 
the response is brought about by the reading of lh(5 copy itsoK rather 
than by the attractiveness of the free sample or Houvciiir aliino. 

An example of a split-run copy test is given in an arliclo by Manvillo 
(3) in which the problem was “to determine tho rehilivi! pulling power 
of the words ‘Talae Teeth' versiiB tho words 'Dental Plate.s* in li((acl]ineH" 
of copy advertiBing Tolident, a eleanaor for false Iccth. Two apUt-nm 
testa were made, one in the Now York Times Sunday Magazine Section 

. *"^^0 authors wish to thank Miss Jano E, PanvoU for drowiiiu tho nouioBranha 
included in this paper. 
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find tlio Kocond in tlii! Now York News Sunday Rotogravure Section. 
The rcsull.H ohliiiiu'd arn mimmurizod hy the author aa followa: 

1, T)jo Now York 'rirnr.-j copy tc.si;, made March 0, 1941, 

yielded ti iiurnhi'r rjf n-plioH, ftl.-l ))er cent of which were from the F.T. 
("Fiilne Tetslh”) unity and 18.5 per cent were from tlio D.P. ("Dental 
riate") copy. Thu rmtliur nlfttoH that "this m wliat may bo called an 
inconchiHivf', ru.snlt; wlioro wipumtiou between tlie competing udvcrtiBC- 
mciit hIio^v.m 1(‘h. 4 than Urn pdlnb (not 10 per cent) difference.* Polidcnt’s 
experience liaa Hlutwn tlmt no innlerial dilTorcnce exiat.s between two 
tcated ft(I^’er^iH(!In(‘n(^^. lEowever, in concluaion, note hero that ‘Faleo 
Tcetli’ wnn a Hhfuh; hetter.” 

2. Tlic roHultH of the Kccond nplit-run t(Mt made in the N. Y. News 
Sunday Rotogravure Section on September 20, 1942, yielded a act of 
rcpIioH, .Ti.f) i)er c(Mit of widcli were from the F.T. copy and 47.5 per cent 
from the I),P. copy. The untlior prcacnt.9 these results, stating “here ia 
another test run to verify results from the first teat. . . . Again 'False 
Teeth' was a slmdo Htronger -aImo.st mathematically perfect." 

Since the author gives only the percentage of returns for each copy 
but doe.s not give tlifj foUd nuinbor of rcturas, it is inipos.sibIc to evaluate 
the significance of lii.s rcHults on a nlaiistiool ha.sifl, Furthermore, even 
if the author bad given tlie absolute frerpicncies instead of the percent¬ 
ages we would still he unable to treat the results statistically sinco we 
have no knowledge of the ruimlmr of readers wjio arc potential buyers of 
the product but faih'd to respond. The latter data arc rarely if ever 
known oven to tlu' research worker. If wo wish to evaluate the above 
results despite this deficiency, certain as-sumptions must bo made regard¬ 
ing the nuinbor of replies as well ns the total number of readers who are 
potential buyers of the product advertised. 

Wc shall present in this paper several general methods for evaluating 
the rc.suIts and apply tlieni to ManviJJe’s data as an example. In order 
to tc.st the significance of his re.siilta, wc shall proceed on two alternative 
assumptions: 

Situation (A): that ho received the minimum average cited by Sturgis 
(4) of 100 replies per tested advertisement or 200 for both; 

Situation (B): that he even may have received as many as 500 replies, 
on the average, for each of his toated advertiaoments or 1000 for both. 

Iiiasmuch as the greatest dilTcrcncc in the two split-ruii teats made by 
Mnnvillo was obtained from the Daily Nows, wc shall confine our ex¬ 
amples to Lho.'io figures, namely, 52.5 per cent for the F.T. copy and 
47.5 per cent for the D.P. copy. 

* It is clear tlmt on BtatiHtiail groundB alono, this Btiitcment is not tenable, Tlio 
absoluLo diflorcnco between two per ccata can not bo evaluated directly, but must be 
referred to ita standard orror. 
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If Manvillo racoivnd a total of 20(1 r.rlia. (;-t. !»■ v.o„M l,„„ 

received 105 (52,5%) fvora (he I'M', vapy (md to, ,!. .a , i 1 > (1„, 11,1. 

"’’’if, on the otlicv liunil, wc nfsuin,' (ha( la- raiciv. 1 jauay a- KM 
repU®, he would have received 525 (rain (la-1'. I ■ ■■'•py aud 1 iK'.n (ho 

^'^Wtran estimate of the aelual auml«r "f r.-pli. > r. n-i’. . d l"r raidi 
copy, we are in a position to lest the siy.,ilivaH‘-<- -i Ua- t. -u ( ■■, I wl » o 
say, whether the F,T, copy really had laare palliiiu |e,<>. i Ihan Ha- 0,1 ■ 
copy or whether the difference is sueh as (a la- iKIrii.uiahh- (a i-haiu-e. 
Unless we assume, however, that live n-liUes vs.-r- „|,(,'aia d inaii a vi-ry 
large sample' of potential bnyans of Ilia pvaihiol esii,.- -d (- (la- advevdMi- 
ments, we will need to estimate the siee a! (la- aa.iiph-, .5. hei.a,- w(- can 

make a statistical lest fov ‘‘ 

trate tlie development ol the test of siKnirwimco f--i- l-flli l■llTUlIn-l!^ll('l‘4 

that ie, the one in which wc fts.siimc a very lurRi' wnniih- 

and the other where Uro s&mplc may ho. rehUivoly small (miv 2(KH)). 

Bothproceebres assume that tlic two vor.iiii«.s of tlir i-npy I n la- Irsli'i 
are equally and randomly dialrilmlcd nmoni!; ivnOor^i wlni uve lUiU'uU'vd 
buyers of the product. It should be iippanmt that nti ediinatv nf Ihii 
8120 of such groups would not in tins pnrlir.ulnr vnso. iu! rtinnl In Um h'lal 
circulation of the paper on the day ol the test. i-Yi-vy mu' nf lb', 
readers of the paper would be a poleiitial Iniycr nf (lu‘. I'luuiu'iw. Um 
actual circulation of the Kewa on the day of tin; h'.st v.ini rci>(ii'1ni as 
2,176,429. It is, therefore, sate to nsawmle tbnt llu' unUud nundici' of 
potential buyers exposed to the coijy was eon.sichiraljb, 

Table 1 

Hypotbetical Diatribnlion of Ilcflponsca to Iho F.T. unil 1 ).1‘. ('npii'' 

Potential Buyers Exposed to Copy F.T.Copy D.l', <‘n]'.Y 'liUnt 

Responded a r “ 't ‘ 

Did not teaparid 6 (1 1' ' 


Assuming then that the two vowiona of the advcndbf'inant la'iuilmd 
grioupa which were equally satutaied wiUv potential luiyevH, wo cun draw 
up the hypothetical two-by-two t-ablo shown in T[il)h; 1. 

* Large as compared to tlia number of rcUinw. Tlio dwi;\iwni>u »f ilic imp'Uiiavi'H 
(if tha relatvvs sire of W w'lh hfi tmted Ifttcv. N<Ae> tbyit Ibo "Suiupb” iuclvuh'A all 
potentiiil buyoTB of tlia product who woro exposed to tho ndvorliiiing copy, and not 
meTciy thenumhet of Ihoso aetunlly Topping. 
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whorl! a ia Uio nviinhor of potcntinl Iniycra who read the F.T. copy and 
Tcspondc.d, h the luiinlior of potential buyers who read the same copy and 
(lid not respond. Tlic letters c and il represent the corresponding data 
for tli(! IXr. copy; is the total number of readers who are potential 
biiyiii's, half of wlioin, iV/2, njnd the I‘\T. copy and half the D,P. copy. 

Let UH (hjliiK! Ih (5 "pulling power" of an advertisement aa the propor¬ 
tion of potential huycir.s wlio road the copy and were sufficiently moved to 
mail in the e.(ni])un iil the cud of the copy. The pulling power of the 
I'\T. copy is tluj i)roportioii tt/(^/2), and for the D.P. copy, c/(A^/2), or 
2afN and ‘2clN re.spcCtively. 

Ill order to dotorminc whether the dilTcreuce between the two "pulling 
Ijowcr.s" is Hignificaut, ive apply the simple test for the significance of the 
(lifferenco between two jicr cents. The critical ratio of this difference, 
Clt, is: 

/T\ nif - - 2 cfN _ (fl - c) 

^ ^ Vp?C2/W + 2/iV] ^pqN 

where p = (a H- c)/A^ and 7 » 1 - (a + c)}N. 

TIuh cfpuition is Horncwlnit different from tlic xisual one given in some 
elementary texts hut it i.s tlie more correct form and tlic justification of 
its use is given elsewhere (5). 


(ID 


IIcuco, Cli = 


_ g — c 

V(a + c)[T - (a + c)/W] 


In onlm' le remove the acpiarc root sign, wc can square both sides of 
the equation and obtain the expression for Chi-square. 

(HI) (cnr- = x’ = (« - cy/ [(« + c)(i - 

Fi.sher and Yates ( 2 ) have pointed out that whenever the smalleat 
expected frequency (number of respon.scs expected for a given copy when 
eluiiice alone or some other definito liypothesis ia assumed to be opera¬ 
tive) is Ics.H than 500, a correction for continuity (designated by them 
ns the Yates correction) sliould be applied. This consists of simply 
reducing the net value of (o — c), the difference between the number of 
rcspon.scH for tlic two copie.s, by unity. Ilcncc equation (III) becomes 

(in') X’ = [|« -c| - !?/[(« +0(1 

L(!t UH now aiqily this cf|niition to test the significance of Situation A 
where tluj total resi)on.sc.s were 200, 52.5 per cent for the F.T. copy and 
47.5 per cent for D,P. copy. First, however, wo must make some assump¬ 
tion regarding tlie sample size, N, the totol number of potential buyers 
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who read the copy, regardless ol whether they responded or did not 
respond. 

Case 1—Few Replies from a Large Sample: Number of returns venj 
mall compared to the total number of potential buyers exposed to copy. 

Let us assume for Case I that the number of returns is negligible 
(less than 1%) compared to the total number of readers who are potential 
buyers. In this instance, equation (III') reduces to a much simpler 
form, as follows: 

If the proportion, (o + c)/^, is negligibie, or approaches zero, then 

(IV) X® = (la-cl -l)V(«i + c) 

and for situation A; = (9)®/200 = 0.40, P == .50, 
and for situation B; y® = (49)^1000 = 2.40, P = ,12. 

In both of these situations the difference is not statistically significant. 
Hence, under the above assumption of a very large sample of readers 
who are potential buyers, the hypothesis that the two advertiseraenta 
were equal in pulling power is quite tenable; consequently, Manville's 
implication that the F.T. copy was really more effective would have to 
be rejected. 

We might reverse the question and ask how large should the difference 
have been in order to produce a significant difference for situations A 
and B. Accepting a value of x* = 6.635 (P = .01) as the lower limit of 
significance, we must solve for a and c, with (a -f c) equal to 200 in 
situation A and to 1000 in situation B. Hence, we solve equation IV 
for the value (| a — c ] — 1), as follows: 

(V) (la-cl -l)> = x*(a + c) 

After determining the value of a — c, wo can readily determine a and c 
respectively, since (a c) is known. 

For situation A; a = 119 and c = 81 (or o * 59.5% and c = 40.5%), 
For situation B: a = 641 and c = 459 (or a = 64.1% and c = 45.9%). 

Consequently for situation A, if one copy had brought 69.5% or more 
of the responses (and the second 40.5% or less), the difference in the 
respective pulling powers would have been significant. 

Similarly in situation 13, if one copy had pulled 54.1% or more of the 
responses (and the second 45.9% or 1^) the difference would havo been 
significant. 

We have prepared a nomograph based on the relationship of equa¬ 
tion (V).* It has been plotted for values of total volume of responses 

• We decided to deal with shBolute fiequs&clea in equation V r&ther than wilh per 
cente (which are more generalb^ used by f^varUsing men) because the equation in its 
par cent form is much mote complicated in its absolute frequency form. The 
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from 100 to 10,000 and for dWcrencea in responees between two copies, 
from 11 to 100. 

Figure 1 is read as follows; When a total number of potential buyers 
exposed to the copies is extremely large, then for any given volume of 
responsea (a + c) tlierc will be a range of possible diflercnces in responao 
(a — c) to the two copies, some of which will be aignificaut. To deter- 
mino whether the difference between a given set of replies is significant, 
proceed as follows; 

The total voluinc of responses (a + c) is found on tiio lino to tho 
right, and tho difference between Iho frequency of responso for the two 
copies is found 011 tho line to the left. By joining these two points witli 
a ruler the exact value of P can bo read from the middle line. This 
value of P indicates liow often a difTcTcnce as largo as (or larger than) 
tlie one observed could arise by chance. Wl^n this difference is so large 
that it can arise by chance less than 1 time in 100 (P = .01) the difference 
is regarded as statistically significant. When the value of P or the 
observed difference lies between .05 and .01, the rc.sult is doubtful, and 
when P exceeds .05, the difference is regarded-as insignificant. For 
example, when the total volume of responses is 200 and the difforencs in 
replies between the two copies is 19, the value of P found from the nomo¬ 
graph is about ,22 and hence not significant. 

The nomograph of Figure 1 can also bo used to determine how largo 
tljc total volume of responsDs must bo in oi^cr tliat a given difference in 
rcplioa will be significant. Thus, when tho difference is 50, there must 
be no more than 375 total responses if the difference is to remain signifi¬ 
cant, since the significanco of a given absolute difference decreases as the 
number of replies increases. 

The nomograph of Figure 1 may also be used to determine the minimal 
aizo of a difference in replies between two copies that will yield a signifi¬ 
cant difference for a given volume of responses. Thus, for a volume of 
500 responaea there must be at least a diffei'cnce of 58 in the two acts of 
replies, for the result to be significant. 


former may bo written fia follows: 

(V') x' =■ CIpi — P*l — Iff® + clTfa + c) 

In ordor to take enre of tlie factor !/(« + r) a double noniogmpJi would Imvo to be iiaed 
instead of tho Hingle nomograph which is oufOcient for equation (V). Had wo noglcctcd 
tlio 1/(0 -f- c) factor completely wo would have overestimated the valiio of x (tho root 
of X* which cquola tlie vahm of tho critical ratio) by as much ca 1/Va c. Por 100 
replies, % is overestimated by .1. This is a amall onougli error, but its fiizo was not 
realized until after tho nomograpliB were drawn. The nomograph in its pet cent form 
has since been drawn up and may bo obtained from tho antliors. 
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We cun [lIho d(iU;niiint‘ llii* .sigiiiricancc of the nssiiltn obtained from 
combining two indopeiKteiit split-nin copy teslH. Tinin, if we were to 
combine tlio values <if x' Kivj'ii by Nomogriipii I for (die rcaults yielded 
by the New York 'i'iineH and the News we would obtain tlie f()llo^vine 
results fur Hiliiidion A and .siUiulion II ( 1 ). 

'J able 2 

Signilioftiici! i»t (hi! DifTcrfmai in llr!iiMni!=e In Iho I'VI’. niid D.l*. Cojjii'H (or Lho Coin- 
liiiHul Ucsiills (d till! Splil-Kuii (.'n|iy TchIs in Uic TiinoH uikI tli« Nows 


For iSititttti/pfi A PVir.Sitiicitiofi 13 

(«-l-c) “ IMX)* («d-c)=1000 

1>.K x’ r.F. 


Times 

.i2r> 

1 

0.7'1 

1 

News 

.'105 

1 

2,40 

L 

Total x’ 

..wn 

2 

3,14 

2 

P 

.80 


,20 



* IIa<l U) liR ci)iii]iulcil (lircotly becauhc iMimogrftph <iiil not oxlcnd to euch low 
values. D.l''. rcjirt'soiils dcgrp'p.H of frccdoiii. 


Under the ass\iiiiption that a total of only 200 responses wns received 
for tlio F.T. and ctipies (situation A), tiic coniI)ined re.siiKs for tiro 
di/Tei'eiiee in respuri.'W! i?i both iiowspupei'.*; would nriso ))y elmnee about 
80 tiine.s in 1(K) and Hue.h a dilTereiiee is not HtalisLieany siKnificanll 
Under the aHHinnpliun that 1000 i'(;.spoii.ses wore received (.sitiiiitiuii B), 
the eoinbined I'cHulls indicate that chance alone would account for the 
difference 20 tiines in 100, whicli is again not significiaut. 

It should be |)ointofl out here that since the total number of rcaponsGs is 
taken to l)e at Ica.st 200 for ailuAtioii A, the nijinbc]' of resjionse.s exjjectcd by 
chance for oacli copy is 100. X'l.slicr an<l Yates (2) have indicated that when 
the ainallc.st expected frcciuency is not less than 200, the value of when 
corrected for coiitiiiuiLy udll give a good flppro.vinifltion of the time probjil)i]ity. 
However, when the iniinber of total rcsponsca falls inucli IjcIow 200 the method 
of x’ iisuiilly fails to give a good approximation to the true probability. In tlic 
case under disouHsion, however, since the two contrasted groups of readers of 
hotli copic.H are con.sidered orpml in nuinhcr, the stringency of the alxive rule 
can he lelaxcid. It Imn been foniul in practice that wlicn the two contrasted 
groups arc e([ual, the method of Chi-square is still npiilicable even when the 
smallest (!xj)('(',l.e(l frcupicncy is as low as 5, that is, wiieii the Lotiil number of 
rcspen.ses is only II).* 

‘Tlio roiuler may wimclor wlietlier it is fair to ooiiHidor only Llii* two (uiliiimis of our 
2 X 2 table ill jiidgiiig whether the coiitrasleil groups are cquul. Wlioii wo compare 
the two rows, Llic coiitnisleil groups arc far from equal. However, tlie value of x’ is 
independent of wJielhor ivc compare Uie r«w.s or 4 lie columns. Ileaec, equality in cither 
is BulTicieut. 
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Case II—Replies from Small Samples: Nunihcr of returns large com¬ 
pared to the total number of potential buyers exposed to the copy. 

We can now turn our attention to the second possibility provionsly 
suggested according to which the number of returns represents a signili- 
cant portion of the total number of potential buyers exposed to the copy. 
Let us accept a sample of 2Q00 as such a number, 1000 for the F.T. copy 
and 1000 for the D,P. copy. Then tho 200 responseH of situation A 
would constitute 10% of the total sample, and the covvcHpoiKlinK pro\ior- 
fcion for the 1000 replies of situation B would be 50%. Wc can now cou- 
atruot Table 3 for situation A, Case II. 


Table 3 

Data for Situation A, Cnae 11 (200 replies from n Hwnple of 2000) 


Potential Buyers Exposed to Copy 

F.T. Copy 

D.P. Copy 

Totali) 

Roaponded 

105 

05 

200 

Did not respond 

806 

005 

ISOO 

Totals 

1000 

10(X) 

2000 


Table 3 is constructed os follows.* First, Manville’s values of .*52,5% 
(or 105 returns for the F.T. copy) and 47.5% (or 95 returns for the D.?. 
copy) are entered in the first row of tho table together with tho total 
volume of 200 replies. Since the total sample of potential buyors is taken 
as equal to 1000 for eacli copy, tho differences between 1000 and the 
number of returns for each copy arc entered in the second row of the 
table. Finally, tho marginal totals are entered. 

For Table 3, x* = '45 with a P value of .50, and hence tho differenuQ 
in pulling power between the two copies is not gigniricant. 

For aituatlon B, Case II, we obtain the tc.sults of Table 4. 


Table 4 

Data for Situation D, Coso II (1000 replica from a eamplo of 2000) 


Potential Buyers Exposed to Copy 

F.T. Copy 

D.P. Copy 

Totals 

Responded 

525 

475 

1000 

Did not respond 

476 

626 

1000 

Totals 

1000 

1000 

2000 


Here again the difference falls short of being sinuificaut y" = 48 
(P = .29). 

In other words, the difference in the pulling power of the two copies 
ia again found to be non-significant for both aituationg A and B, even 
when the total sample of exposures is small. 
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W(J rikii n*v.'n'(! (hi* nnd (ii'terniino wlurn n (liffcicBCG in 

pullinff limvcr will l.i- if Ihe Jiiunplo oonsiHtu of only 2000 

polciitinl Ijnyrr.'.- cxiMi-i-fl h, fhr ropy, KHXj for Uic F.'V. copy and lOOO 
for tlic I).l\ I'lipy, and with Uio lolal numlmr of roUirnH taken na 200 for 
silualiuJJ A imd llHH) fur Mltjfdiiui J?. 

iSulviiiK ninulinii (III') f.,r (!« - c\ - l)^, wo obtain 

(VI) (|<; fl - 

Silico wo know (lie vnluo cif ri -I- o, wo oaii hoIvo Lho cipiation readily. 
For Hilnatiou A (2(H) ro]>lii‘‘i from a tntiil Naniple of 2000): a — c = 35.5G; 
nnd fl h n ■ - US; c. - H2. Hcnco if lho total Kample of expo- 

fiiirc^s wen- only 2IHH) ainl Ihi* rospoiiKoa to the F.T. copy were 118 or 
more (and for (In- IJ,!'. copy 82 or llio dilTerciico would have been 
eignilicaiit, 

F'lir -sitnalion II (UKKf replicH from a total flampio of 2000): Solving 
equation (VI); <i ■ ndO and c -- lyo. Ilrsncc, if 530 rcsponacs or more 
had bwo) n^of'i^V'd In (In,? I-'.T. copy (and -170 or Ic.ss for the D.P. copy) 
from a tnlal i-ample of cjnlj' 20IK), the difTeroiico would have been aig- 
niiicaut. 

C'fl.M’ III 7i'r.sfd/s/«i- « SnmjiU: of 4(KX) Exposures. 

Uit m now (fiiiedder .HiUialion A ami P, but in.stead of a total sample 
of 2000 poleiiUal Iniyern exposed to the copy let uh asauino a total of 
1000 micb cxposnren. raradoxieally, llie value of dropn from .16 when 
A/2 " 1000 III .:(7 when A72 — 2()tK) for the 200 repliea of situation A, 
and from d.H to 3.20 for tUe 10(K) replicH of mtnation D. Both of these 
values of ai(! In-low llie eritical vahie of HiKiuficance (x^ = 0.635), and 
hence, the <lirfei'enc(‘ cannoL be coiiHidctcd BiKmfieant. But in both cases 
the value of x’ deeremied a^s increaKcd- Tliis is pcriiapfl unexpected 
since iiHiiully I Ik- value of x’ incvouscH a.s N incroases or, in other words, 
tlio signllicamie (»f a f^iv(‘n (llfrercuci! iiicrea.sesas tlw sample size increases. 
Wo inuHt reiiienibi*r, however, that our problem ia aomewhat unusual, 
since for a given nnmber of replies the jmlling powers, 2a/N and 2c/A, 
decline uh /V, I lie size, of llm Hainple, increases and consequently the 
niimcraLor in eiinalion (III) alsii <lccHnos. On the other hand, the de- 
noininator im-reaHeH as N increases sinco the oxjn'es.sion 1 — (a -{- c)lN 
will hicreasc lu. ;V iiK-iea.se.H, providing (u -f- c) nuiiains unchanged. Thus, 
with the nniiK-ralor (lecn-asing and the demnninator inci'ensing, the value 
of the ratio, x’, must p«Tf(iree (kadinc. 

IfoweviT, tlie vidne of x* eannot decline indefinitely, for ns A increases 
iudofiiuU-ly, the ^’alue of x’ ap|n'oa(:hc.s ([« — c| — l)V(a -h c) as a limit. 
Tlierofore, if the Itniiting value of x* gi’calcr than the value G.635, 
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increases in the value of N will not reduce tho signifieanco of tlio (hflci- 
ence, but decreases in will increase the aignifiennee of the vcsult. Ou 
the other hand, if the limiting value of x’* is less tluui tiijdo. a decroiise 
in N of sufficient size may produce n signiBcant difforcnco. 

Case JV—The Maximum Siie of Sample that will yield a oi{fuiJicani 

Dijfmnce Jo)'a Giwn Number of Replies. 

Since we have determined that the value of dccvcuHeH for a gwiiu 
number of replies as N, tire size of the total aami)lG, iiiei-dnsoH, wo Jiiay 
now reverse the problem and inquire how email must bo in orilor to 
produce a significant difference between tho pulling power of two adver¬ 
tisements in a split-run test. 

(VII) Solving equation (III) for N, we obtain 


_ (fl + c)^ 


(m'l m = v<«+<) - ^*"(8 + E)»^ ” • 


Applying this formula we find that N ia 213 for A. Ilenco when 
the total volume of replies is approximately 2M, or 107 for each copy, 
the results are significant in favor of the F.T. copy. When the volume 
increases above 214 the results are no longer sbafciatienlly sigiiirieanL, Hut 
what happens when, the sample falls below 214? Obviously it cautvot 
fall indefinitely below 214 since the total sample can never l)e hi.ss tlian 
the total volume of responses. In fact, the minimum value for the 
sample size is twice the number of responaea obtained from the copj' with 
tho larger number of responses. This limiting situation is tho one wliieli 
produces maximum differentiation between the two copies. This oi)ti- 
mum circumstance is obtained when all the readers of one copy rc.sponcl 
(a hypothetical situation which will hardly ever occur), In tho case of 
situation A, the optimum circumstance for a possible significant differ¬ 
ence is shown in Table 5. 


Table 5 

Optiimim Circumstance for a Possible Significant Differcnco in Situiilion A 
(200 ropliea) 



F.T. Copy 

D.P. Copy 

Total 

Responded 

105 

05 

200 

Did not respond 

0 

10 

10 

Total 

105 

105 

210 
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III T«l)Jo 5 Dk'I'O i,s n tofiil of 210 rojulorfl of whom liiilf, 105, read the 
RT. copy uiul luUt tlie D.P. oojiy. Of Uie 105 who read the F.T. eopy, 
nhrcsi)oml(Ml; while (F llio.se wlioroad tlie D.P. cojiy, 10 failed to respond. 
The value of .‘'fpiare for the alajve tahlo l« 8.51. T]ni«, when the 
volume of nisiionscH is 200, of whioli 105 oomo in ro.spoii.se to tlic F.T. 
copy iiml 05 to Llu! D.P, eojiy, wo may coiieludc tliat Lho F.T. copy Ls 
Buperior in ]iiilliiit^ power to (lie 1),P. eopy as long as the total .sample size 
lie.s liotweeii 210, llio iiiinimal jiosHilile si/x*, and 210, When the total 
sftm])le goes nmeli beyond 2111, the dilTcrenoo is no longer atiitiatically 
Bigiiillcant, 

For .situation 31 (1000 leplie.s) Lljo optimum rc.sult i.s shown in Table 0. 


Table G 

Optimuni CirctiiaHlimcc! for a Pos.dhlc Sii'iiifietiut DifTcrenco in Situation B 

(lOfK) rcpHw) 



F.T, Cojiy 

D.P. Copy 

Total 

llcKponclcd 

&25 

-175 

1000 

Did ikjL rospoinl 

0 

SO 

50 

Telal 

525 

625 

1050 


X® - 50.•12 and lienee tliu dirTeronce in the pulling power of tho F.T. 
and ]).F. eojiy of Manvillu's Daily Nowh split-run Lest would have boon 
alatistically sigidficaiit if the total Hiuiiple of potential buyers exposed to 
the co])y were only 10.50 and tlio^otal number of i'cplie,s received wore 
KXX). Siicli a largo numboi' of repliew hs 1000 may very well be unlihely 
for tho ono in.serlion of Lho advortlReinonts. In any event, it is oven 
more unlikely that the mor(! than twe million circulation of the Daily 
News inohided not more than 1050 readcr.s who were potential buyers of 
Folident, 

We can now ask how largo may M grow above 1050 before the diFer- 
enco becomes non-significant, Substituting in equation (VII), 


N = 


(lfl00)‘ 


1000 - 


w 

0.035 


1506 


IIeii(!( 5 , wJkmi iV is 1500, or 783 I'e/iders for eacli copy, t)ie diFerence 
bidween 525 ro,spouses for the F.T. eopy and '175 for the D.F. copy will 
still b (5 significant. However, when Lho .sample execed.s 1500, the 
(lin'ereuce in pulling power of the two copii.'.s becuino.s .statistically doubt¬ 
ful. In other words, as long ns tlic total number of readers (evenly 
divided Ijctwccn the two Gopioa)'dieS"betwe6ii-1050-aud.-L50G, the diifer- 
ence in pulling i) 0 WGr for thej litJiAQ 'sijt^EiJLiipn Bid,■3 significant, 
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When N increases to tibout 15GG, the differenee l)ef;inH to fail hehnv Iho 
significance level, Thus, when we have some estiumte of Mio nuint)or of 
readers exposed to aplit-rvm copy, we can detenninu for a Rivoii sot of 
replies whether or not the difference in pviHing power is fiiRoifieaiit. 

Two nomographa (llA. and IIB) have been devolopetl whicli will 
indicate the maximum value of N that will yield a Hignificant diffei onco 
between observed results. These are pre-sonted in Finnre.s 2 and 
They are based on equation (Vir). Letting y = (H-l-a)“^V(Ui - cl - 1)^ 
equation (VIT) becomes: 

(VII") W = i/(fl + c) “ Vy 

We can draw up a nomograph for detetmimiig the values of y from tho 
values of (a -f c) and (a — c) for tliesituation, when = O.fi3o {P — ,01). 
This nomograph (IIA) is shown in Figure 2. 

The left hand column gives the total number of rcHponsoH (u -h c) 
and the right hand column gives the difference in ro.sponsos botwoen tho 
two copies (o - c). The middle column givc.s t!ic value y whioli is to 
be used in Nomograph IIB. A ruler connecting the two points for 
{a -h fl) and (a ~ c) respeotively will cut the middlo lino fit tlio desired 
value of y. Having detei-rained the value of y, wc enter with this value 
of y on the line to the right in the Nomograph IIB and by connecting tlio 
point y on that line by means of a ruler with the point for tho total 
number of responses {a -1- c) on the line on the loft, wo can rfiad off in tlio 
center the value of N required to render the difference significant. 

Example for NomoQraphs IIA and IIB: When tho total nuinbcr of 
responses to both copies is 1000 and the difference in reapmiRcs lictwoon 
the two copies is 60, we enter Nomograph IIA in the left hand column 
marked (a + c) with the value of 1000 and connect this point with the 
ruler to point 50 on the right hand Bcole and read off tho value of y on 
the middle scale as 2650. With this vahie of y we enter tlie right hand 
scale of Nomograph IIB and connecting it up with tlio point correspond¬ 
ing to 1000 on the left scale, we read off the valuo of V = 1500 on tho 
middle scale. That ia to say, when the total number of rcaponsca ia 
lOOO and the difference in response between the two copies is 50, a total 
sample of not more than 1500 potential buyer-readera would bo required 
to make the difference significant. 

Nomographs IIA and IIB cwi be used in any ono of four ways. 
First, to determine the maximum valuo of N that will yichl a flignificant 
difference for a given set of replies, aa was done in the cxatnplo above. 
Second, to detennine that value of a difference in replies (a — c) which 
would be significant for a given size sample (N), and a given vohimo of 
replies (a c). Third, to determine the volume of responses (a -f c) 
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which would yield a Rigiiincnrit (lifTerence for a given didercncc in replies 
(fl - c) and for a given aamplc size (N). Fourth, to determine the 
siRnificnnce of tlie observed difference by obtaining the value of x® 
directly, In order to iitifizc liie nomograph for this purpose, only one 
computation is recpiired.^ First, determine from Nomograph HB the 
value of yii corresponding to tlie oljserved values of (a -|- c), the total 
nmnber of replies ami {N) the total sample. Secondly, determine the 
value of y from Noinogniph IIA which givc.s tlic value of yA corresponding 
to the olworverl number of roplie.'i (a -pc) and the dilTerencc in replies 
(a — c), The desired value of x’ is obtained from the following formula: 

x’ ^ (fl.G35) 
yti 

Knowing the value of x^ wo can determine P from any table of x^ 

Discussion 

Thus far we Imve dealt only with the statistical aspects of the split- 
|rim copy technique. However, it is to be emphasized that there arc 
'certain assumjitioiis which tlie technique must satisfy before the statis¬ 
tical mcthorl becomes applicable. These assumptions are: 

(1) That the two copies of the advertisement have been so distrib¬ 
uted among two groups of readers that theao gi'oiip.s constitute random 
samples of the population under examination—randomly divided at least 
insofar as the product being advertised m concerned. 

(2) That the two groups contain an approximately equal number of 
potential biiycr.H of the product. (The method can also be applied when 
tliQ potential number of buyers of the two groups is not equal; in such 
case, however, their relative number must be known.) 

(3) That a valid estimate of the maximum size of the sample of 
potential buyers is available. It should be borne in mind that no amount 
of statistical refinement can compensate for any gross error in the original 
estimate of the size of the samples under comparison. 

* A more direct way of accomplisliing this purpoao is to note tlie fact that Nomo- 
grapL IIA is based oa the value of x’ = 6.035 aa the Dritical point. This valuo of x’ 
is found on tho y scale opposito tUo value 31.6 = (VlOOO) on the (n + c) acalo. (The 
deoimnl point has to ho provided by Hie rondor.) liy providing a duplicate y Hcalc and 
moving up or down wo can lot the critical value of x* vary from 0.035 to any other 
value wo plcaao. After dotcrinming the valiio of y for a given observed result by means 
of Nomograph IID, wo can outer Nomograph IIA and let the duplicato scale move up 
or down until tho valuo of ya lies under tho ruler eonnecliug up (o -b c) with (a — c). 
Tho valuo of x’ for the obsorvod compariaon can then be rend off at the critical point 
(corresponding to 31.0 on the (o -|-c) scale), with proper care for tho decimal point. 
The corresponding value of P can bo obtained from standard tables, 
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(4) That the act of clipping the coupon at the end of the copy iH 
indicative of interest in the product, flud furllierniorc, tiiiit this act was 
brought about as a result of the reading of the copy, and not aa a result 
of any other factor, 

When two contrasted copies are found to yield remilt.s which are 
significantly different, care must be token not to place too much reliance 
on this fact alone. The statisticfll procedures (]&scril)ed ntwvc to indicate 
whether a difference in a given set of replies is or is not greater than 
would be expected on the basis of olianco flione. Tlio atlriliutiiig of a 
superiority in pulling power to one copy over the otlicr must ho iniL- 
tressed by evidence of a logical or a psychological kind. If the result 
flaunts common sense, the test should be repeated until it i.s vorUied 
beyond any doubt, 

If it stands up under r^etition, it would he well to iuvc.stigato the 
causes of the differences before the superiority of one form over llio other 
is regarded as established. Simple methods for coinhining the results of 
two or more tests are presented by Ifisher (1) and an example has been 
worked out in this paper, 

Application to Other ProblcmB 

The nomographs described in tWa paper oi'o useful in oLlicr HiLuationa 
besides the split-run copy technique. They will be found useful in item 
analysis of psychological tests when tho hvo contni.sLcd groups of suc¬ 
cesses and failures are equal. For this purpose, Nomograiihs IIA and 
IIB should be used. The advantage of these nomographs ovew ])rQviouH 
ones inheres in the fact that the significanoG of an item can l)c read olf 
directly from the nomographs once the values of (a - c), [a + c) niul N 
are known. 

Whenever the incidence of rare events is contrasted in two groups, 
Nomograph I can be used to determine the significance of the difference 
in the incidence of the event, if the two conti'asted groups are very large 
and equal in size. Examples of studies in which many rare cventa or 
characteristics are compared in two contrasted groups arc quite plentiful. 
Among these are studies in thB incidence of rare diseases and accidents 
in different racial or industrial groups. Comparison of the incidence of 
rare words in contrasted authors or manuscripls is anotlicr exainplo, 
Nomo^aph I offers only an approximation to the value of tlio exact 
probability and should be useful as n screening devico for Kclectiug the 
Gomparisons that need further study with the exact methods developed 
by I'isber (1) or by means of the Poisson distribution which is suitable 
for the evaluation of the statistics of roi’o events, 
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Summary 

In cletcrinining the relative pulling power of two cliflfGrGnfc forms of 
the fifimo advertising copy, a method known as the aplit-copy testing haa 
been widoly used. Heretofore only rule of thumb mothoda have evU 
dently been widely used in the evaluation of the results of this technique. 
TliG present articlo develapa simple formulae which are modifications of 
the basic C!hi-.s(iuar(5 formula for equal contrasted groups (marginal fre- 
qiicncic.4 in the columns, or in the rows). One of tlio difficulties charac- 
tcrltitic of many atudics in tliis field is the abacnco of any precise data 
regarding the actual size of the imoiber of readeca of tUa advettieemeuts 
in question who are potential buyers of the articlo advertised, Conse¬ 
quently it bccomcfl necessary to indicate maximal and minimal sizes of 
samples wliicli will yield statistically aignificant results for a given set of 
returns. Three nomographs arc presented for eliminating all computa¬ 
tions and obtaining the required answers directly, These nomographs 
can bo used for any situation in which a comparison is made between the 
frequencies of an event (a reply, in the case of advertising copy tests) 
for two equal contrasted groups. Nomograph I is to be used when the 
frequency of the event under investigation is small (less than 1%) as 
compared to the total aample. Nomogmpla IIA. and IIB are to be used 
when the frequency of the event is considerable (higher than 1% of the 
total sample). The use of these nomograplis has the advantage of re¬ 
quiring no computations whatsoever, the significanco of the results being 
determined directly from the raw data. 

An example from the literature of a duplicated split-run teat for com¬ 
paring the pulling power of two advertisements was carefully analyzed. 
The results wore found to be statiatically non-significant for each teat 
separately as well a.s for both teats token in combination. 

Received Januar]} 3,10^. 
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Relationships Between Strong Vocational Interest Scores 
and Other Attitude and Personality Factors 

Leona E, Tyler 
Universily of Oregon 

At the present stage in the progress of voeiitioiml interest resoareii, 
the most cMenging problems arc those coneernecl witli fciio nature of 
the characteristics which dtoentiate one occupational group from 
another. A vast mass of information hn.*i ftcciimulated witli regard to 
empirical differences between groups and rclalion8lui)H between cUirCTRiit 
interest scores (4). So far only a few studies have nttompted to clarify 
and explain these relationships or to fit the traits under consideration 
into a general theory of personality. 

Purposes of Tliis Study 

The chief aim of the present study was to analyze in some, detail 
relationships between scores on the StTong Vocaiio7ial Inlcrcul Blank and 
several measured attitude and personality factors. This involved Roiiig 
behind the correlations to discover, if possible, why the scores corrohitcd. 
It was hoped that such a procedure would throw light on llie nature of 
differential occupational interests and would also add to our riudevHitmd- 
ing of personality organization. It is to be remoinbered that the interest 
tests are practically the only so-callcd personality tests which have any 
objective outside reference. We know that intere.sb seorca rollocb choices 
people actually make and plans of action they actually carry out. To 
be able to relate other measui*ed characteristics about which we know 
less to this reference point would have some real advantages. For the 
author, this study is related also to plans for a longitudinal investigation 
of the development of interests in children. Exploration of the relation¬ 
ships obtaining for adults shows what characteTistics aro in'ii)ortant to 
observe in a genetic study. 


Procedure 

The subjects were college sophomores taking psychology laboratory 
at the University of Oregon in the fall term of 1941-1942, 55 men and 
122 women. The battery of teats conaiated of the Stronf) Vocational 
Interest Blank, the Uinmsota Pmonality Scale with its five Hub-tcats 
measuring Morale, doefa! Adjustment, Family Adjustment, Etnotional 
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Adjustment, and Economic Conservatism, and the Thurstone and Chave 
scales, Altiludc toward the Church and Attitude toward God (No. 22, Form 
A), The Strong teste were scored on the following group .scales: Group I. 
Human SoieiiccH; Group II. Technical Sciences; Group V. Personnel or 
Social Service; Group VIII. Office Work; Group IX. Sales; and Group 
X. Vorbal-Linfiuistic. 

Tlie first step in the analysis was the computation of correlations 
between oacili of the interest snores and each personality and attitude 
variable, keeping tlic data for men and women separate. These coefli- 
ciente were chocked for statistical significance by Fuslier'a “i." All rela- 
fcian.ship.s for which the probability of significance was more than .95 
were fioloctcd for further analysis. This conaiated of an item analysis of 
tlio personality measurcinciit under consideration. We singled out the 
iiuUviduaks receiving liiglic.st and lowest scores on the interest scale. In 
the men's group, wc compai'cd the 20 highest with the 20 lowest. In the 
women's group we used tlic 33 highest and the 33 lowest. T)io person¬ 
ality teat papers of these individuals were removed from the rest of the 
pile, and the responscfl made by high and low groups to each item were 
tabulated. On the Minnesota Te.st, where the respondent marks each 
item 1, 2, 3, 4, or 5, the mejvn value of the responses in each group was 
obtained, and the dilTcreuco between means of high and low groups 
checked for sigiufieaiicc by Fisher’s “f.” On the Thurstone scales, where 
the response con.sists of cliccking or not checking each item, simple per¬ 
centages were obtained and checked for statistical significance. By this 
mcthccl, personality itom.s which were dearly related to interest scores 
wore sorted out from those which were not. 

The next step, for tests in winch there tumccl out to be enough of 
such items to make the task worthwhile, was to vcscoto the papers by a 
key which included only the discriminating items. The correlation of 
interest score with this special score based on selected items furnishes a 
better estimate of tlie relationship of interest and personality factors 
than docs the original correlation. For tlie most significant relationship 
obtained in this way, a further check was made. A group of 38 cases, 
not used in the item analysis, was chosen from the author's counseling 
files. The intcrcsi-iieTSDnality correlations were calculated for this group 
al.so. 

One problem aro.‘?o in the design of this investigation, the solution of 
which was not entirely satisfactory. If the women’s form of the Strong 
blank were used for women subjects, group scorc.s could not bo obtained. 
If the men’s blank were used, there would be some question a.s to the 
meaning of the women’s .scores. Since there is con.siclerable evidence 
that meaningful scores for women can be obtained with the men’s blank, 
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we decided to use it, wntching for any indication of Hex dilToroncoH in the 
regulta. Unfortunately, only about a third of Llie worts men, 

so that the moat unequivocal results rest on tho .smaller ruimljcr of case.s. 

Ucsults 

Male Subjects. Correlations between mterosl acorea and oilusr per¬ 
sonality variables are shown in Table 1, which revoalH scvoral intoro.stiriR 
facts, First, the Social AdjuslmmL teat is tho only oim from llm Minne¬ 
sota Personality Scale which shows more timn one Hignincaiit correlation, 
with Strong scores. The Famly and Emoiional tcata do not correlate 

Table 1 

CoTrelationa bctwcon Strong Group ScoTta and Personality anil 
Attitude Scores, N = 65 Men 


Porsouality Tests 



Morale 

Social 

Family 

Emot. 

I'lc, 

C’uhh. 

Attiliidn 

Olid 

Attihido 
Olnirch ‘ 

Group I 

Human Science 

-.24 

-.32* 

.00 

-.U 

-.20* 

-.26* 

.341 

Group II 
Technical 

-.03 

-.36t 

.27 

-.06 

-.01 

-.32* 

.32* 

^ Group V 
§ Peraounel 

1 Group VIII 
Office 

.17 

.26 

-.12 

-.12 

-.00 

,04 

-.20* 

.23 

.14 

-.03 

.00 

.24 

.17 

-.20* 

Group IX 

Sales 

.03 

.40t 

.00 

.22 

.00 

.381 

-.2fi 

Group X 
Verbal 

-.34t 

.04 

-.23 

-.10 

-.10 

-.02 

.23 


' High scores indicate unfavorable attitude. 

* Significant at 6% level (Fisher's *'i" teat), 
f Significant at 1% level. 

with anything. Morale is negatively related to Verbal interest scores 
and Economic ConseruaWsm is negatively related to Human Science interest 
scores. Otherwise, correlations involving these two siib-te.st.s are too low 
for eignificance. Second, correlations of the Social score with Grovips I 
and II, on the one hand, and Group IX, on the other, arc oppo.sito in sign 
and approximately equal in aize. Third, one or both of the roligioua 
attitude scales correlate significantly wth all Strong scores except 
Group X. The directions of these relationships are conBistent, Less 
religious attitudes go with soience scores, more religious with personnel 
and business. 
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Item analyaia of the relationghip between Group X and Morale turned 
up very little that was interesting. Only three items gave significant 
“i'a." These ai’o: 2, Joys of family life are much over-rated; 9. A high 
school education is wortli all the time and trouble it requires; and 39. A 
good education is a great comfort to a man out of work. The correla¬ 
tion in this case seems to reflect simply a slight tendency for men with 
high verbal interest scores to be less optimistic about things in general. 
Practically all the items showed tlus trend, but in none except these three 
was it marked enough to result in a significant *‘i’' {5% level). A pessi¬ 
mistic slant in Group X men may be attributed to either the higher 
intelligence or the larger number of dislikes on the Strong blank itself 
which is known to characterize many men in this group. 

Similarly, item analysis of the relationship between Group I scores 
and Economic Conservatism waa unfruitful. Only two items showed sig¬ 
nificant differences: 186. If our economic system were juat, there would 
be much less crime; and 193. A man should be allowed to keep as largo 
an income as he can get. Here too most of the other items showed a 
tendency for individuals with high Group I scores to respond less con¬ 
servatively, but differences were slight. Such a trend may again reflect 
nothing more tlian the slightly superior general intelligence usually asso¬ 
ciated with high Group I scores. 

It was in the item analysis of the Social subtest that the most inter¬ 
esting findings appeared. Thirteen items out of the sixty-five showed 
significant differences between high and low groups on one or more of the 
three interest scales with which the scores were correlated. A scrutiny 
of these items indicates that they have in common one rather limited, 
specialized phase of an individual's social personality—namely, his atti¬ 
tude about the desirability of friendship with many people. The four 
items on which differences are most pronounced for all three interest 
groups under consideration are: 66. Do you like to meet new people?; 
72. Do you get along as well as tlie averse person in social activities?; 
84. Do you like to know a gi'eat many people intimately?; and 88. Do 
you prefer to participate in activities leading to friendships with many 
people? To each of these questions, the sales group gives a much more 
social answer than tho two science groups. Items concerned with other 
attitudes toward people and social affairs do not differentiate. Self- 
consciousness, embarrassment, unliappincss about one’s blunders, lack of 
aggressiveness, failure to get along with people—none of these has any 
demonstrable relationship to the interest factors differentiating salesmen 
from scientists, The social characteristic involved here is a matter of 
preferences rather than adjustmeni. 

When the Social teat waa scored by a key made up of only the 13 
differentiating items, the results shown in Table 2 appeared. There 
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aeems to be little question that the social trait tapped by the 13 (Ur- 
criminating items is related more closely to scienfciac and sale,s interests 
than is social adjustment in genctab The most conclusivo cocflicienta 
are those baaed on the cases from the dies. While the Cxroup I r is lower 


Table 2 

Correlations between Strong Scoroa, Groupa I, H, Will IX, nnd Scorea cn Scnii^a ior 
Measuring Sociiil AtliuBfcmeiit or AHjtiido.s 



Complete 
Social Scale 
(Orig. Group) 

N = 66 

I3-Iteni 

Scale 

(Orig. Group) 

= B5 

13-Item 

Scale 

(Cftsea from Files) 
= 38 

Gioup I 

-.32 

-.67 

-.41 

Group II 

-.35 

-. 6 « 

-.02 

Group IX 

.40 

.68 

.00 


for this group than for the original subjects, Group II is about the same, 
and Group IX is actually higher. The full importance of these correla¬ 
tions becomes apparent when we realize that on the basis of the 13 social 
items alone we could predict Strong scores on Groups I, II, and IX witli 
about as much accuracy as we prediet school marks from intelligence test 
results. 

The item analysis of the AlHiade (twaord God scale showed, as ono 
might expect, that the principal differences stemmed from a tendency of 
the scientifically-minded to avoid the more mystical positions, such as 
"God is the underlying reality of life.” There was no clifliivcncc on anti- 
religious items; few if any of these subjeeta checked thorn. On the 
Attitude toward the Church scale, the principal difference between ecicn- 
tiats and personnel and business men seemed to be a greater tendency 
toward skepticism among the former about whether or not the church 
produces all the good effects claimed fw it. Differential responeea to 
such items as “I feel that church attendance is a good index of the 
nation's morality” are typical of this trend. On this scale also, the anti- 
religious items were avoided by everybody. The difference between 
scientists and business-peraoniiel men might be described ns a difference 
in amount of indifference, not opposition, to the church. 

The last step of the procedure, scoring the teat on diacriminafciug itema 
alone and recalculating the correlations, was carried out for the AlUlude 
toward the Church scale. (Thei-e were too few items in tiie otlier to make 
it feasible.) The outcome is shown in Table 3. Again the coiTelations 
are larger with the scores based on discriminating items alone, but tlio 
increase is less marked than, for the social variable. Since on acalea of 
this type subjects check only those items with which they agree, it is 
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probfible that irrelevant items carry less weight in the original score 
than they do where the other scoring technique is used. 

A possibility tlmb a few items on the Strong test that happened to be 
closely similar to the social items we have sorted out might account for 


Table 3 

Corrclntione between Strong Scores, Groups I, II, V, VIII, nnd IX, and Scores on 
Scales for Measuring Attitudes toward the Church. N ^ 65 



Complete 

Att. Church 
Scale 

lUtom 

Scale 

Group I 

.34 

.40 

Group II 

.32 

,40 

Group V 

-.29 

-.28 

Group VIII 

-.29 

-.40 

Group IX 

-.25 

-.30 


the obtained covrclationa also needed to bo checked. An item analysis 
in the reverse direction was used for this purpose. That is, the responses 
on the Strong test of the 20 individuals who were highest on the 13-item 
social scale were tabulated and compared with the responses of the 20 
lowest. Differences showed up on a large number of interest items scat¬ 
tered throughout nil parts of tko blank in such diverse areas as, for 
instance, liking geography and handling horses. This suggests that a 
different general outlook differentiates these people and not just a few 
specific preferences. 

Another que.stion of some significaace is whether or not social and 
religiou.s attitudes arc correlated. This seems to be the case. The corre¬ 
lations between the special social scale and the special church scale is .40. 
Thus inborost scores could be predicted from a combination, of the two 
with only slightly more accuracy than from the social score alone. 

Female Subjects. For the 122 women in the study, correlations be¬ 
tween Strong scores and other personality variables are shown in Table 4. 
There are more statistically significant r’s than for the raen's group 
because the larger number of cases makes a smaller coefficient significant. 
Numerically, most of the coefficients are somewhat lower than those in 
the corrCiSponding cells of Table 1- It is interesting to note that all the 
significant relationships are in the same direction for women as for men. 
The principal difference between Tables 1 and 4 is with regard to the 
religious attitude scales. In Table 4 only one of tlie relationships be¬ 
tween religiou.s attitudes and interests is significant and that one (Group 
V vs. Aitiiude toward God) is very low. Group V interests, which for 
men are most closely associated with favorable attitudes toward the 
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Table 4 

Corrolationa between Strong Group Scores oml I’erfloniiVily nnd 
Attitude Scores. = 122 Women 



Morale 

PetBonahty Tcala 

Social Family Einot. 

Ec. 

Cons. 

Albitiidc 

(lOtl 

ALLitude 

Church 

Group I 

Human Science 

-.26** 

-.27** 

-.15 

-.20* 

-.12 

.01 

.00 

Group II 
Technical 

-.14 

-.27** 

-.08 

-.07 

-.11 

-.17 

.14 

m Group V 
§ Pereonnel 

.23** 

.34** 

-.01 

.14 

-,19* 

,10* 

-.06 

-g Group Vin 
Office 

.10* 

.05 

.14 

.07 

.08 

.01 

-.06 

Group IX 

Sales 

.16 

.38** 

.13 

.12 

.23** 

.08 

-.16 

Group X 

Verbal 

-.09 

-.01 

-.07 

-.07 

-.06 

-.05 

.11 


* Significant ob 6% level (Figlier*B “I" teat). 
** Significant at 1% level. 


church, are in women most clewly related to social characteristics and 
morale. 

Item analysis of scales other than the ^Social again selected only 
scattered items, difficult to fit into a coherent pattern. But out of the 
53 items on the Social test (Women's Form) 41 differentiated high from 
low people on one or more of the interest scales. A great many of these 
are significant for Group Y only. Women high in personnel interests 
give more extraverted responses than others to almost all types of ciucs- 
tion. A smaller set of 19 items differentiated scientific and sales interests, 
oa did the set in the men's data. There is more of a tendency, however, 
for items pointing toward social maladjustment to differentiate between 
these interest groups of girls. For instance, the item, “Do you find it 
easy to make friendly contacts with membci^ of the opposite sex?," has 
no differentiating value for men, butshows up significantly in the analyses 
of four scales for women (Groups I, II, V, and IX), the more social answer 
characterizing girls with personnel and sales interests, the less social, girls 
with science interests. The results of xescoring the blanks by the 19- 
item key and recalculating correlations are shown in Tablo 5. Coeffi¬ 
cients are increased by eliminating non-discriminating items, but not so 
markedly as is true for men. This also may indicate that items having 
to do with social adjustment and happiness are less irrelevant to intereata 
for women than for men and thus have a less depressing effect upon 
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correlations. Unfortunately, relationships in the women's data could 
not be checked in a new group, as the counseling files contained too few 
cases of women who had taken the men's Strong test. 


Tabic 5 

Correlations botwcon Strong Scores, Groups I, II, and IX, and Social Scores on 
Minnesota Personality Scale. JV = 122 Women 



Complcto 

Special 


Social 

lO-Itcra 


Sciilo 

Scale 

Group I 

-.27 

-.41 

Group II 

-.27 

-.37 

Group IX 

.38 

.47 


Discussion 

The facts outlined above can be brought together under a few main 
headings. First, it is to be noted that interest scores on Group I, Group 
II, and Group IX scales are the only ones showing consistent significant 
relationahipa to other personality factors. We have uncovered nothing of 
any importance about the other group scales, except that women^a 
Group V interests tend to accompany higher socialization and morale 
and men’s Group V and Group YlII interests go with a relatively favor¬ 
able attitude toward the cliurch. The scientific and sales interests are 
at opposite poles in all the relationships investigated in this study. 
Many of Strong’s reported results show the same trend (4). 

The second generalization is that there is a social factor related to 
interest differences. This factor, for men, is centered around the sort 
of social stimulation they prefer and seek. The more a man tends to 
avoid large numbers of acquaintances and indiscriminate social affaire, 
the more likely he is to show the interests of scientific men. The more 
satisfaction he takes in social affairs involving large numbers of people, 
the more likely he is to resemble salesmen in hia interests. Items having 
to do with maladjustments and unhappiness do not differentiate between 
men’s interest types, Women show the same general sort of difference 
between persona with scientific and sales interests, but the nature of the 
social factor is a little less clear-cut. The same items concerned with 
liking or avoiding social affairs constitute its important component, but 
8om,G other less-easily-catalogued items also differentiate, Girls with 
high scientific interests are likely to be somewhat 1d,s,s well-adj listed to 
the opposite sex, somewhat less confident and happy in their social rela¬ 
tionships than girls with other types of interest. This may be because 
in the direction their interests are taking they are departing rather mark- 
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edly from what society expects of women and nrc tluis iiiLrodiuiing Home 
strain into their relationships with people. It is impoHsihlG to detenniue 
from the data at hand which of these variables is cuuse mul which effect. 

A genetic study should thiw liglit on these doiilitful i.SHiies. 

Postulation of an important social factor around which other atti¬ 
tudes cluster suggests hypotheses explaining several puxzling facts turned 
up from time to time in interest research. Miuiy have woudcicd, for 
instance, why artists should be classified with physicians, ii.sycliologisls, 
architects, and dentists, by the con’clations hetwoeu mLcre.st scores. 

A similarity in social outlook might be the basis for these correlations. 
The predominance of scientific interests in adolescent boy.s is another' 
such research finding. The social attitude.^ of 15-year-old boys, if they 
carry other attitudes along wth them, could account for tliis. The 
correlation of interest scores with success in selling life iusiivatice might 
also involve this third factor. If the liigh-.scoring men have a different 
social outlook, that could easily account for their selling more insurance, 
All these hypotheses could be checked statistically without a great deal 
of trouble. 

Another general finding from this study seems worthy of moution,— 
the general ]ack of relationship between interest scores and ndiat we 
loosely term "neurotic tendenGy.” There is no covi'clatiou for cither rcx 
between interests and family adjustments. There i.s only one low sig¬ 
nificant correlation between interests and emotional adjustment, and tliis 
shows no particular trend in the item analysis. None of the items on the 
social scale referring to relatively serious maladjustment.^ or neurotic 
symptoms differentiate in any interest group. It may well be that there 
are two independent variables in personality, the direction which it takas 
and the success or effectiveness of the adjustment made. We Imvo per¬ 
haps given too much attention to adjustment in personality study, and 
too little to this other consideration of the direction of development. 
There is certainly no evidence here to suggest that neurotics tend to pile 
up in certain occupations. 

That correlations with I'eligious scales are significant for men but not 
for women may indicate that vocational interests are a more funda¬ 
mental factor in male than in female personalities in our culture, more 
closely integrated \vith the individual's whole cosmic orientation. As in 
most studies, our women subjects averaged slightly more religious than 
the men, but the differences were not statistically signiflcaut. It is to 
be remembered that the differences in men are not on the anti-i'eligiou.s 
items but on those showing skepticism. The tendency ono might expect 
to find for business men to be more conservative than scientists shows 
up more plainly with regard to religious issues than in regard to economic 
opinions. 
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Flually it should be noted that the results presented in this paper 
coincide in several respeels with some other exploratory studies, The 
table given by Darley (2) shows the largest number of significant critical 
ratios for the scientific interest groups and the social scales, particularly 
/Social Jh'f/crcncfiS. hiavlhn and Hevdie (!t) find more .significant differ¬ 
ences in Allpoi't-V(n-non scores for Groups I and IE than for the others. 
Tiissing (5) finds that scoring keys for the Strong blank can be con¬ 
structed to mcasiu'o somewhat the same hvetons as the Bci'iiroutcr F-lC 
and F-2S scales and the liell Social scale, but not tlic other Bell scales. 
It would be possible to fit the results of this study into Bordin’s (1) 
theory that “in answering a Strong Vocational Interest Test, an indi¬ 
vidual is expressing his acceptance of ii particular view or concept of 
himself in terms of occupational atcrcotypos," if wc a.ssume that attitudes 
toward social affairs and friendships are important features of the stereo¬ 
types for some occupations. 

Summary 

1. A social factor having to do ivith feelings about organized .social 
affairs and friendships with many |X! 0 ])lc k related significantly to Group 
I, Group II, and Group IX scores on the Strong Vocational Interest 
Blank, 

2. Religious attitudes show a moderate correlation with vocational 
interests in men but not in women. 

3. Scorc,s indicating neurotic tendencies show no appreciable relation¬ 
ship to any kind of interest scores. 

Received December 1,10/,3. 
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A Worry Inventory 

A. H. Martin 

The Universily of Sydney, Sydney, Auslralia 

This inquiry originally constituted on endenvour to suiiply an alter¬ 
native form to the usual questionnaire used as a measure of maladjusted 
trends in personality. In place of presenting questions requiring the' 
underlining of answers either "yea" or "no," direct but brief description 
of symptoms were set out. Test subjects were first required to underline 
those items which had ever worried them. When this task was com¬ 
pleted, they were further required to make a ring around the number of 
any of the underlined items which at present still conatitutod a cause of 
worry. Two scores were thus obtained; the first consisted of an "effec¬ 
tive" score of worry items; the eecond score noted existent present 
worries. In administration this inventory proved to bo far easier for 
candidates to answer than the usual questionnaire form of personality 
inventory. 

The questionnaire generally used for vocational guidance work in 
Sydney, Australia, for candidates from fifteen to twenty-five years of 
age is Thurstone’s ^ selected questions, modified by a foiv necessary local 
emendations and the addition of three "jokers," i.e., catch questions to 
which the better answers are “Yes." 

Regularly each year some undergraduates liavo commented on the 
difficulty of following the directions for this questionnaire, The effort 
of fine discrimination required to arrive at honest decisions, appears to 
be great. At the same time, the questionnaire does actually sort out 
many cases showing inferiority trends, shynesB or “nervousnesfl." These 
individuals may be directly helped by an interview or two involving a 
brief analysis of the subjects' self-centered attitude. There were 42 
questions in the original Sydney inventory and the average number of 
“yields" per person was from 10 to 11 questions. Self-confident indi- 
viduala of a good "sales" type tend to register from 3 to G yields. Occa¬ 
sionally types with pronounced “inferiority" or neurotic trends show 
from 15 to 36 question yields. A Factorial Analysis ^ ahowa the ques- 

^ThuretoDfi, L. L., and Thuretone, T. G. A nourotio invontory, J, sac. Peychol,, 
1930,1,3-30. 

* Gibb, C. A. PeraonaUty traits by f&ototial aiuvlyais. Aust. J. Psychol Phil, 
June, 1942,1-16. 
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tiona themselves tend to cluster about such trends as schizoidj submissive, 
a-social and manic-depressive. 

Worry Inventory 

Since the general principles involved in the Thurstone type of ques¬ 
tionnaire had proved so useful for many years, it acemed advisable to 
retain the principle involved and yet to seek some simplification of the 
questionnaire method. Accordingly the direct method was decided on 
for a try-out. Every existing list of worries, patterned after Wood¬ 
worth’s ® original lead, tends to be cast in the form of questions. But 
this method is neither economical in its setting out nor is it often easy 
for the candidate to answer. The itemized list, used here, however, 
directly denominates each symptom, which has been reduced as far as 
possible to very simple and unambiguous teiins. The method of marking 
the items was first to got subjects to underline those which had ever 
caused them worry. After completing the list thus, they were required 
to put a ring around the number of each item wliich was still a present 
cause of worry or distress. Two individual scores were thus secured. 
If the items are honestly marked, the first indicates the general nature 
of individual worries; the second score is indicative of the nature and 
extent of existent worries. This procedure of underlining and ringing 
was borrowed from the method prescribed in the Presaey Emotional 
X.O. Test. 


The Group Tested 

The original group of individuals tested consisted of undergraduates 
attending classes in Psychology in years I, II or III in tlie University of 
Sydney, together with a few outside pemons attending one of these single 
coui’ses. About fifty per cent of tlie undergi’aduates were students en¬ 
rolled for evening courses. Altogether 100 persons were used as subjects, 
48 being females and 52 being moles. Their ages varied from 17 to 47 
years, but gave a preponderance to subjects of earlier years with a very 
decided skew towards the higher years. The average age for both sexes 
combined was 20.4 years. In order to enable ob.'^ervations to be made 
upon age trends, the scores were separated into male and female results 
under the following age divisions: (a) 17 to 19 years, (b) 20 to 21 years, 
and (3) over 21 years. No differentiating trends in age or sox aiipeiircd, 
cither in yields to particular typos of items, in actual numbers or in tlic 
proportion of existent worries to general worry problems. The six sub¬ 
groups, though fairly uniform in trends, were nob large enough for any 
reliable inferences to be drawn. Some degree of selection must have been 

• Franz, S. I. Handbook of mental test methods. New York: Macmillan Co., 1020. 
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operative in the male section with respect to militn-ry service, iicncc this 
samplvTvg cELn haxdly he regarded as “average” and fully rcpreflcntative. 
In the female section no such factors of selection probnbly came into play. 

The subjects did not record their names oti tlic alicets unless they 
wished, but merely indicated sex and ago. 

The Present Inventory 

The items mth their two results given alongside, nro shown in Table 1. 
The items were arbitrarily selected by the writer on a lepresentativo 

Table 1 

Items ia tlio Worry Invoatory with Porcootiigo of "Yiclcla'’ /or 
100 Univeraity Studonta 

Percontngfl 
of Yiolda 

I* II** 


1. Poor health 

20 

7 

2. Boing dUIoroat in appearance to other folk 

23 

7 

3. Having a poor appetite for food 

3 

0 

4. Bad iodigestioa 

3 

1 

6. Lying awake at night 

20 

0 

6. Disagreeable dreams or oightmarca 

23 

0 

7. Constant aches or pains 

2 

0 

6. Night sweats 

8 

0 

9. A dislike for certo-in kinds of food 

21 

11 

10. Spells of dizziness 

11 

0 

11. Thoughts of death 

28 

Q 

12, Being nervous or shy 

7C 

18 

13, Sudden heart trecaors or pedpitations 

U 

7 

14, A tired feeling after waking 

20 

10 

15, Prequont headaches 

20 

8 

18. Entertaining folk 

31 

16 

17. Thoughts of suicide 

0 

0 

18. Being found fault with 

48 

16 

19. Not taking part in eporta or games 

16 

1 

20. Slccp'walking 

3 

0 

21. Being too quariokamo 

13 

2 

22, Loneliness 

26 

S 

23, Bad asthma or shortness of breath 

5 

3 

24, Feeling bored or "fed up" with life 

29 

4 

25. Sexual problems 

31 

12 

25, Mind wandering or day dreams 

26 

6 

27. Constant had luck 

3 

0 

28. Being tensed or made a fool of 

30 

7 

20. Not being undoretood or appreciated by people 

16 

2 

30. Meeting members of tho ojq^osite box 

30 

6 
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Percentage 
of Yielijs 


T !!*• 


31. Being treated unfairly by others 

30 

5 

32. Leaving titsku imriniBhcd 

20 

12 

33, Gelling no ploaanro out of life 

8 

2 

34. Talking too tnnoli 

15 

7 

36. Lack of Hucceafl in your sLudics 

22 

0 

30. Not being loved at homo 

0 

1 

37. Addrcaaing groups or incQtings 

38 

21 

38. Being closely watched or observed 

30 

12 

39. People’s wickeduesa 

7 

6 

40. Being a failure in your job 

10 

3 

41. Feeling Bclf-consciovis 

54 

27 

42. Brooding over your sins 

9 

1 

43. Having wrong thoughts 

23 

8 

44. Going into tunnels or subways 

2 

1 

45. Nob being your real self 

10 

3 

46. Some spceoli dilTioulty such as stammeriDg or lisping 

10 

G 

47. Looking down from n height 

31 

IG 

48. The need to do things over and over 

10 

2 

40. Tilings seeming unreal to you 

11 

3 

60. Talking in your sleep 

7 

3 

61. Not being able to converse easily with people 

33 

13 

62, Making one of a crowd 

10 

2 

63. Your lack of true fcieiKls 

11 

5 

54, Bliiahing 

37 

16 

65. Lack of sclf-confidcnco 

34 

17 

50. Twitching of the face, head, body or lunbs 

7 

4 

67. Your religious beliefs 

10 

0 

58. Some vagvio couBUnb fear or worry 

14 

0 

50. A fear of going insane 

7 

1 

60. Inability to Dx your attention on books, workorstudiea 

28 

19 

01. Having a bad temper 

21 

5 

62. Being afraid 

14 

4 

63. Meeting with or talking to elders or social superiors 

20 

7 


* Direciione I, Firat read carefully through every item mciitionecl below and under¬ 
line everythin^} whicU hoa ever troubled or worried you. 

** Direclions II. Now go through each item underlined and if it is etill worrying 
you, draw a ring around ita number. 

basis from a wide array of existing “personnlity'^ quc.sLionnnires. Whore 
two items were not mutually exclusive and teiulcd to cover a particular 
symptom, the better, in hia judgment, was retained. 

Of all the sixty-three items only seven proved to be uni)roductive 
by showing a total yield of only 3% or leas. These items are Nos. 3, 4, 
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7 8 20, 27, and 44. Th.s last indicated that clnn8tmpliol)ia is a fairly 
infrequent symptom compared witli No. 47, whicli involves ''looking 
down from a height.” For use with a normal and reprc.scntative group 
of individuals the seven items could well be omitted, 

The remaining fifty-six questions were nybitvarily diKtributwI by the 
writer under the headings shown in Table 2, Tliey live arranged in 
descending order of frequency of ocourrcncc. 

Table 2 

Grouping of Itcroa in the Worry Inventory by CntegoricB 
AvctftgQ Porcontftgo 
No. of Ever Still 


Type of Difficulty 

Items 

Worried 

Worried 

ItoniNumhera 

Sex 

3 

31 

6 

25,30,48 

Inferiority 

21 

28 

5 

2, 12, 10, 18, 22, 
28,20, 31, 34, 36, 
30,37,38,40,41, 
40,51,53,54, 65, 
03 

Physical Symptoms: 

Ce&versioii 

10 

16 

8 

1, 9, 10. 13. U, 
16, 23, 44, 47, 60 

Schizoid Trends 

16 

18 

5 

B, 0, 11. 17, 24, 
20, 32, S3, 45,48, 
40, BO, 52, 58, 59, 
00 

IteliglouB Difficulties 

3 

12 

6 

30, 42. 57 

Fear and Anger or Cyclo- 

thymic Trends 

3 

14 

3 

21, 01, 62 

Totd 

66 

21 

6 



Payeho-analytic literature would probably technically label these as 
erotic, narcissistic, conversion or hypochondriac, repression, super-ego 
and accumulations of id symptoms and trends. On the other hand, the 
nomenclature of various factor analysts * -would use other specific terms 
such fis “laek of ccin&d&Titi&/' "solitariness'^ for the inferiority and schizoid 
trends, The remainder -would hardly find a place, The chief concern 
of the investigation was to indicate certain practical advantages of tlio 
method of presentation and the method of marking the items. 

The results presented exhibit a decidedly different aspect to those 
obtained from the general run of such inventories, both in the matter of 
items, the item gi-oupa and the extent of the prevalence of such diffi¬ 
culties. This inventory, therefore, tends to shed a different light on the 
‘ Gibb, G. A.j op. cit. 
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nature of nervous worricfl and problcmB to that of the ordinary porson- 
ftlity questionnaire, It cannot, of course, be indicated to what extent 
the disclosures of such worries was due to the anonymity covering the 
individuals who answered the inventory, but at least one-third of the 
group voluntarily Hubscribed tlicir names. Piirtlier tlio writer ^vas 
brought into contiiot with the groups concerned ns lectUTcr, so that a 
certain degree of ra])i)(jrt possibly existed. 

Do those average frequencies really indicate the relative importaneo 
of the groups of iLoins? One cunnett answer directly to this ques¬ 

tion. In the first place theuunilrcr of questions relating to ''Inforiovity" 
amounted to 21 or almost 40 per cent of the total of tlie items, yet the 
group ranks second in average importance to that of sex dilTiculLies which 
is represented by only three items. 

But seven items of the inferiority group approach or show a greater 
percentage of yields than tlie most heavily weighted item, No. 30 of the 
Sex Difficulties group. There is, hence, no conchisivc evidence hero 
supporting cither the exclusively Freudian or the purely Adlerian theories 
of personality. Tlie individual render must interpret the results in lus 
own way. It can be stated, however, that the present inventory is 
possibly moro "revealing^* in many ways than the Thurstone Ques¬ 
tionnaire. 

Later on, both the Worry Inventory and the Tlniratono Inventory 
were administered to a group of 3C studonta of both sexes, for the sake 
of comparison. Tlie following correlationH were obtained: 


Thurfltono Inventory and Worry InvoDloiy Underlining.!. = .81 i .038 

Thurstone and Worry Inventory Ringing.-. = ,76 ± .050 

Worry Inventory Underlining nnd Worry Inventoiy Ringing. . .= .81 J: .038 


To supplement this a test of extraversion wq.s administered to the 
same group within a week of giving the others. The results were: 


Ertruvorsion and Thurstoiio... = - .40 ± .035 

Extraversion and Worry Inventory Underlining. = — .50 ± .077 

Extraversion and Worry Inventory Ringing. = - .67 ± .05 


Thus, there appears to be a remarkably coiisistont constant factor 
emerging from all these tests os revealed by these correlation results 
whioh is probably that of intro-extravovaion. Wliilo its symptoms are 
legion, one underlying cause, that of cgo-ccntricity, appears as tlie prime 
cause of the human difrioiiltic.s. 


Summary 

1. In the present "Worry Inventory" a list of sixty-three items was 
presented to a group of 100 university atudente of botli sexes ranging 
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in age from 17 fco 45 years. The inventory in intended lo l>e n'lirc.stjntii- 
tive rather than exhaustive. 

2. The method of administration of tiie Inventory [jrovod .simple and 
far less difficult to answer than the u.siml Iwfc of jjer.soniilily ((lU'Htioii.s. 

3. Its use tended, po-ssibty under a cloak of mioiiymity, towards a 
higher yield of nervous difficulties and a wider liold of synipiomH, than 
is usually uncovered by the usual questionnaire moUjia). Ilowinau*, some 
fair proportion of the excellent re.sults Is probably duo Lo tlui diic^ct 
approach used in the present Inventory. 

4. The Worry Inventory correlated to a very high dogreo wilh the 
Thurstone Questionnaire. 

Received November ^0, lO^d, 



Sdcial Factors AnnayiiiR to Children 

Kusp ZcliRN 

.li' .-i /■!,’■'" .’’’i I, ^'niriritna, (it,in 

Till' iiri rill wmtM !j*M; In llu* liiuiiliurdmciil, iif iliHlurh- 

niicc.i niul uiiiii'Viiiii' i IK'.O rirftcl »'liildrrii rnid nmiriliillc. In iiisliiliilily 
iimi lurk Ilf iiiiiM', A '\w‘ "i in rliiMn'ii'mliiily 

.' li'iiil'l ruiildi' )»nr<’iil'i nii‘i li'urluT'? In cliiiiiiiiili’ iiiiniy of llic 
fiii'l'iri' Mild i-i li(')|i (lio rliiMri-ii ii'ljnMl. to luiniiyaiUTH Mint lire 
imavniilalili'. 

This piiiiiT v\ill liiM’ii' i; I'hildri'iiTi rr.'irlimiM lo jiniioyimiM'ii Mioy ofton 
cxpt'di.'io'r. Till' iMiiitpriii'd 11 a jiixlh-Ki'itili! lioys and I'lO RIjIh 

from two 'lUlinrliMii clriitHiOiry imMio M'lionlf* of CiiiciniKiti. Ninoty- 
niiio par I'riil of ihc i liildroii wm* ntilivo Imrii, 71) iici' rent Jowinh, 27 
per (i(*nt wiTi' ?i"i('.fi*\vi'di, Mild a pi-r ri'iil wi*ri‘ colon'll, llii’lr uvcrfiRC 
clirniioloRinil mri' v.(i» II yrara and S iiionllif-', and llicir niciilnl 

ORe, (iccordiiiR lo ilo' * Hi!' (Irniip Iiili llif'i'in'i* Sciito, Advuiirrd JvMuniiin- 
lioU, Form H, v>n • 11 yi ur.". Tin’ i-'orio rconoiiiic ImckRround was n liltlo 
below very liiRli on ( 111 -Siiii:iFi:ori‘t‘nrd. 

2Srt uiMli Rradi' rhildri'ii wito askril In list all tliiiiRH wlucli 
nimoy, irrilutr, and Imilo-r llirin. Tlir ilciiiH wi'i'o classilkd umler HOdiftl 
rcliUiniDiliiiM, lii'idlli and aiipi'aiaiin', limin' nnd family, Htihool, hobbies 
niid interests, fninh!, peiiiniml emidiml, Rumes and ainiiKeineuks, foirfl, 
iniioaveiiience.'t and [(iiiioyanoes, iininnils and insoels, and ciiyii'imnicnta 
coinliliuiiH. 

Tim follnwiiiR year I be iimlenal wus |ire.si'nli:d io llio 285 sixth-Riftf o 
children of llm l anie eehools, de.si’i’ilH'd ulnivn. Tim inuLciial, in Iho foim 
of sdiiarate U-st.s for l.oys aii.l Rirl.s, provided for live difTerout degreos ot 
feeling toward every ilcia listed. T'liese were iikv, dm t mind, don I 'o, 
hale, ainl hale vvieli. T'lie eliildreii were asked to encirelc the expression 
that best descrilied their feeling toward eaeh item listed. The material 
wfw tabiilaled, eliiinged In |»er eeiila, nnd arranged according to frequency 

for fuih: »}i<i:/i, , I . 

Thin paper in a ri-pm t of llm ileina elasnilied under social relationslupa. 

honu! nnd fiunily, m'IhioI, and per.Honal e.oinlucL 

AlliLuiles of Hoya 

Table 1 lists soeial silimlioiiH l.lnit are annoying (don’t like, bate, and 
Imte inmdO to 05 per cent of the l)oyH aludied. They are eapecia y 
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Tabic 1 

Attitudes of 146 Boys Toward Social Situations 


Item 

Per Cent 
Who Marked 
"Hate Much" 

Item 

Per Cent 
Who Marked 
“Hate Much" 

Bb bliuned for something I 


To bo slapped 

34 

didn't do 

50 

To bo ridiculed 

33 

People who cheat 

60 

Sarcaetic remarks 

33 

Unfair things 

60 

Two against one 

28 

A bully 

66 

People who talk too much 

28 

War 

66 

Ugly people 

20 

Have people angry at me 

61 

See girls act grown np 

20 

'Po lose someone's things 

46 

See people erying 

26 

To ho poor 

45 

Hcot talk on eoU-control 

24 

People who show off 

44 

To borrow money 

22 

A eiesy 

44 

Old maids 

22 

People who tell lies 

43 

People who talk too fast 

22 

People who laugh when I 


People who talk too slowly 

21 

get hurt 

43 

To fight 

19 

People who always argue 

40 

Long religious Bermor\e 

18 

Stupid people 

40 

To be alone 

18 

To lose in a fight 

37 

People on diets 

14 

To fight little boye 

37 

To talk on telephone 

13 

A mean person 

37 

Certain boys 

13 

To get into trouble 

a? 

Certain girls 

13 

Tattletales 

36 

People who not funny 

12 


The average distribution for oU iteme, in terma of por cent, waai Liko 10, Don't 
mind 19) Don't like 21, Hate L7, sad Hate much 27v 


disturbed when blamed for something they did not do and by people who 
cheat, unfair things, a bully, and war'. They do not like to have people 
angry at them, to lose someone’s things, or to be poor. People who talk 
too much, who lie or argue, who are stupid, mean or sarcastic, who laugh 
when others get hurt are very much disliked by the boys. Sissies, show- 
offs, or tattletales rate low with these boys. They do not like to lose 
in ft fight or to fight with little boys, to get into trouble, to bo ridiculed, 
or to be slapped. The boys vary in the number of situations that annoy 
them and in the degree to which they are annoyed.^ 

Table 2 gives home and family situations that are annoying to many 
boys. They dislike most to get a whipping, especially for something they 
did not do, to be scolded, punished, or nagged. 

Some of the boys do not like to do various chores around the house, 
run errands, or take care of smaller siblings. 

^Roae Zellgg, The relationship of emotional and pononality traits to learning in 
children (unpublighed Doctor's diMertation, University of Cincinnati, 1037), 
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Tal»le 2 

AUUiuIm <if M5 l^dyiiTiuvnnl lirtmfi and Fninily 


- 

for ( Pill 



Wflo Mnrkfti 



Item " 

llnUiMiich" 

IIpiii 

“Hate Much" 

To get n wliifi|)ing for nomr'- 


To wiihIi niul dry dislica 

13 

thing I didn't flo 

02 

To ftwrnp lluorti 

13 

To gel ft wliiii|iing 

M) 

To wiuih tli» iHLlhtnb 

13 

To boeeolilcd 

42 

To work nrouiul llio Iiouho 

13 

Lctbrollicr l)toftk rny gniuea 

:ui 

To go to Imd Into 

12 

To be jniiiisliecl 


TodiiHl forniiiuo 

12 

To be nagged 

;iri 

To nel tho table 

12 

To clean tlic cellur 

23 

To fight with brother 

10 

To BOW 

21 

To clesn golil-hsii bowl 

10 

To wftiL in etorc wliile inollier 


To cook 

10 

shops 

20 

To go to tho fltoro 

10 

My Biatcr's Hinging 

1» 

To Inko euro of house 

0 

To go to bed early 

10 

To bIiovcI Bnow 

0 

To Bcrub 

10 

To go to bed 

0 

To olenn tlic hoiiBO 

M 

To rake tho yard 

8 

To Iftko cero of eou.Bin 

13 

To run erroiKls 

0 

The ftvorago difllribnlion fur nil iUnnn, 

in turina of per cent, was: 

Ijiko 23i Don’t 

mind 33, Don't like 11), llnlo 11, niiil IIaIo niMrli 17. 



TiUiln II 


Attilnilc's 

<d Hr> HoyH Towiird Sntionl Hilnnlionn 



I’er (V)i»l 


Per Cent 

Who Mnrkr/) 


Who Marked 

Item ‘ 

‘llftln Miifili" 

Uoin 

“llftloWucli" 

To get low niurkK 

4V 

To go to .Sunday School 

13 

Certftin Uftcljorn- 

-10 

To do nigbtwork 

13 

Teaclicrs who Imvo pct« 

30 

T'o have to mins Kchoul 

12 

Do sent to principid 

30 

To write book reporU 

U 

To hear tcdchcru prciieb 

30 

To Bliidy grnminnr 

11 

Tcflclicrs who (lisllkc! tiic 

3(1 

To go to flchnof 

0 

Writing IcHHona 

23 

To give tftlks 

0 

To mcinorizo pocruH 

21 

To iiliidy liiiiljiry 

a 

High Hinging 

IH 

To rend iiiy coinpunilinnH 

7 

To write conipDiiilionii 

17 

To (iiko urt 

7 

Singing in 

H 

T‘« Iftkn t{*.'ilo 

ft 

Arithmetic 

13 

To Htiidy gciignipliy 

-1 


Tho iivcrngo diatriliuLUm for nil ileum, in lemiH of pur ceiiL, wi\h; Like 3-1, Don't 
niincl 27, Don't like M, flute 0, iiiicf Ilnlo nuicli l(f. 
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Though many school contJicts are enjoyed by tbc boya, it cm be Been 
from Table 3 that the boya dislike most to get low marks, cortain teachers, 
teftchera who have petSj who preach, or who do not like them, and to be 
sent to the principal. Almost 20 per cent of the boys hate or hate naucli 
to go to school while 40 per cent of them have that same reaction towards 
Sunday School. Writing and singing lessona represent the least-liked 
Bubjecta, while manual training and gymnafriimi work are tho favorite 
subjects. 

Table 4 lists the boys’ attitudes toward personal conducb. Heading 
the list are character and personality qualities. To curse, tell lies, or be 


Table 4 

Attitudes of t45 Boys Towoid Pewnud Conduct 


Item 

Per Cant 
Who Marked 
"Hate Much'’ 

Item 

Per Cent 
Who Marked 
"Hate Much'' 

To curao 

67 

To break windows 

38 

To tell lies 

62 

To btfig 

36 

To be stupid 

61 

To got angry 

32 

To be QDDUsed of lying 

51 

To lose in & bull gnmo 

30 

A guilty conscience 

47 

To lose in any gntno 

28 

To lose money 

46 

To hiirbaomeonQ 

28 

To cry 

45 

To lose in card games 

26 

To lose a fountain pen 

45 

To lose in marbles 

25 

To bite my nails 

41 

To attract attention 

18 

To lose anything 

41 

To kicfl people 

15 

To hm bad habits 

38 

To be still 

12 


The average distribution for all ibeniB, m torms of per cent, Wfla: Like 4, Don't 
mind 13, Don’t like 25, Hate 22, find Hats much 36, 


accused of lying and to have a gpilty conscience or bad liabita arc greatly 
disliked. Other annoying Bituationa involve the loss of money, fountain 
pen, or other possesaions, or to lose m games, 

Attitudes of Gills 

Girls express annoyance to a greater number of situations and to a 
greater degree than do the bosrs. Table 5 contains many more items 
showing girls’ dislikes in social situationa than are found in Table 1 for 
boya, Moat disturbing to the gWais towitn^s pain and suffering, people 
getting killed, sickness and deatii. Social rdationgbipa that rc,‘iulb in 
lowering their dignity or personal status are very annoying to tho girls. 
These include being accused of something they did not do, or of lying, 
being called a cheater, made fun of, treated like a baby, called names, 
scolded, or called a poor sport. 
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Table fi 

AUiUide of 140 (lirla 'rownnl Social SiLimLioiifi 


Item 

Per f'rnl 
Wlui Mnrkpil 
"Hate Much" 

Item 

Per Cert 
Who Marked 
‘'Hale Much" 

See pco])Io getting killer] 

118 

A stale juke 

35 

Do acoiiiiorl of HomcthiiiK 1 


Ciroiicliy children 

30 

didn’t do 

D8 

Kcinsli pceido 

30 

Do called a eheaUT 

ni 

lie hoUicred when reading 

35 

Sco people Huder 

.1(1 

(Juarrcl with boy friend 

35 

Do treated like a baby 

TiU 

(Diililrcu acting babyish 

33 

Bo mtido fiin of 

5.1 

When friends act foolish 

33 

Hear flomaiiuo lifus dir-d 

53 

People who talk too much 

33 

Be called imincjj 

51 

People who don’t like to do 


Do Hcoldcd 

50 

nuylbing 

33 

Do botlicred or pestered 

50 

A dull parly 

32 

A bully 

48 

People who gossip 

32 

Pcoplo who arc fakers 

48 

To lose ill a gnino 

32 

To SCO Bomceno nick 

48 

Thoughllcss pcoplo 

32 

To be railed a poor sport 

48 

PJay with soinccino 1 don’t 


To bo ncciiHcd of lying 

48 

like 

31 

Asauniuto with dirty pcoplrj 

17 

Not to go to parties 

31 

Pcoplo wlio lie 

47 

Pcoplo who talk in movies 

31 

Nasty people 

47 

To ho leased 

31 

Pcoplo miiidiiig iiiy liiisinerii 

40 

Visits to horing pcoplo 

31 

Jealous pcoplo 

40 

lie tensed about boy friend 

28 

A dry spcccli 

45 

Diacourtcous cliildrcn 

27 

To bo cinbnrrtuiscd 

15 

Silly pcoplo 

27 

To see a cliild whipped 

45 

To fight 

20 

Sissica 

44 

To got angry at eomcono 

25 

Children who elioat 

43 

To bo iratfoiiizcd 

24 

An uiitruo friend 

43 

Smart person acting dumb 

23 

To bo iiiBuUed 

43 

People who arc cros.s 

23 

To play with mean children 

43 

Not to go to (lancing school 

23 

Constant nagging 

43 

Pcoplo who arc rough 

23 

Sec people biting their nnilE 

1 43 

PerBisting people 

22 

Conceited pcoplo 

42 

To be dioappointed 

22 

Stubborn people 

40 

Kissing games at parties 

21 

Have privileges taken away 

40 

To pay full car fare 

22 

People who are pests 

40 

To viBit sick adulU 

20 

Pcoplo who brag 

40 

Talk about self control 

20 

When friende get sick 

40 

Boya who make love lo mo 

10 

Sco a cri|)])lo(l person 

30 

Talk long on one Huhjcct 

10 

See children show of! 

30 

To take revenge 

18 

Sloi)i)y pcoplo 

38 

People who act funny 

17 

A hairy actor 

38 

Have big reapoiiBibililics 

15 

Stupid pcoplo 

37 

To talk long on ])honc 

15 

To be yelled at 

30 




Tho average distribution for oil itemB, in terms of per cent, was: Like M, Don’t 


mind 14, Don’t like 20, Hate 22, Hate much 30. 
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Moat of the girla express extreme dialike for antisocial people such 
ag those who lie, mind other people's business, are jealous and nasty. 
They don’t like sissies, flhildren who cheat, and nn iintnie friend. I’or- 
sonality traits annoying to the girb are conceit, fitul)l)oi’iin(!s,s, .sloppines-s, 
grouchiness, foolishness, eeiaslmess, stupidity, and tliouRhtlcsancss. 
Constant nagging and teasing, visita from boring people, and iudividunla 
who bite their finger nails, talk in movies, and gossip arc disliked. In 
general, the girls reflect very definite atandarda of social conduct and nn 
unfavorable attitude toward those who do not live up to those stiindiivds. 

Also, in their attitudes toward homo and family tho girls reflect 
standards of family relationships. As seen in Table G, practically all the 


Table 6 

Attitudes of 140 Girls Toward Home jmd Family 


Item 

Per Cent 
Who Marked 
''HateMu«5h'' 

Item 

Per Cent 
Wlio Marked 
"Unto Much" 

Make parents unhappy 

64 

Not to SCO loktivcs 

21 

A spanking 

52 

To w&ah and iron clothes 

20 

To irritate my mother 

so 

To fae bothered by sister 

20 

When mother is angry 

41 

To scrub 

10 

To be punished 

41 

To wash stockings 

12 

To be scolded 

37 

To rrosh dishes 

12 

To stay home on Sunday 

36 

To duet furaitaro 

11 

A dirty yard 

36 

To make beds 

11 

To Bee little brother cry 

31 

My sistods singhig 

10 

To have my things bothered 28 

To sweep 

0 

Not to help mother 

24 

To dnrn cocks 

9 

When mother won’t buy 


To ^ to hod Into 

0 

things I want 

33 

To clonn the house 

1 

To he bothered by brother 

22 




Tho average distribution for nil items, in terms of per cent, waa; Like 20, Don't 
mind 24, Don't like 18, Hate 14, and Hate much 18, 


girls dislike to make their parents unhappy ov angry, to be punished or 
scolded. Though they do not like to be pestered by siblings, most of tho 
girls like their little sisters and brothers and do not mind taking care of 
them. Practically all the gh'la like babies. Some of them dislike house¬ 
work, but very few girls dislike company or going out on Sunday, 

As shown in. Table 7, maladjustment in achool i.s displeasing to the 
girls. They are extremely disturbed by bad report marks, unsatisfactory 
lessons, or poor conduct in school, especially if these require tlioir mothers 
to come to school. They do not like teachers who got angry, scold, or 
give long lectures, or fail to mark papers. Writing lessons are liked least 
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Table 7 

ALtitii(lc.H of HO (lirls Toward School SiLimtiona 


Item 

Per Cent 
Who Msrlced 
“Ilate Much” 

Item 

Per Cent 
Who Marked 
"HateMuch" 

Bad re{Kirt marks 

58 

Writing lcfl.40ii8 

21 

When niolher liuH to como 


To have iiightwork to do 

21 

Bclwjol 

40 

Tcftohora who don’t mark 


Not to know my lewion 

30 

papers 

10 

To l)D bad in sebool 

30 

To diseuea pocma 

18 

Not U) linvd my homework 

34 

To cojiy things over 

18 

To make tenchcr angry 

33 

To memorize pocma 

18 

When I can’t answer n queation 33 

To make book reports 

17 

To get nervous in ft teat 

31 

To go to Sunday School 

13 

Too much iiigliLwork 

30 

To carry books 

13 

To do iKvrd lessons 

27 

To study 

13 

Long lectures by teachers 

25 

To have teats 

a 

To talk out in Rchuol 

24 

Certain teachers 

11 

Toacliora who scold 

23 

To Imvo school over 

10 

To moinorizo lassons 

22 

To wribo oompoaitions 

0 

To Bttvy homo from school 

22 

Grammar 

0 


The ftvenvgft dwlrilmlion lor all iUnns, m Uirms ot ^lor cent, woa: Like 20, Don’t 
mind 23, Don't liko 17, Ibito 10, and Ilato much ID. 


of all the subjeobi, winie (^ymnoflium work, spelling, drawing, and goog- 
mpliy are lilcod most. 

Antiaocial cfinracfcor and pci'Homility traits (Table 8), as expressed in 
their personal conduct, aro annoying bo tho girls. Telling lies, being 
bad, mean, or unreliable, doing wrong, or getting into trouble are marked 

Table 8 

AttitudcB of 140 Girla Toward Personal Conduct 


Item 

Per Cent 
Who Marked 
‘Ilato Mijcli" 

Item 

Per Cent 
Who Marked 
“Hate Much” 

To havo bad habits 

6S 

To make plana and drop 


To tell lies 

5.5 

them 

34 

To bito fmgornail.s 

63 

When I do wrong 

31 

To hu bml 

51 

Ti) forget things 

28 

To be iiicaii 

51 

To sit in perfect silence 

23 

To be unrcliablo 


A Bclt-conHcioUB feeling 

21 

To get in troubln 

42 

Wlion I can’t do iih 1 like 

10 

To bo idle or lazy 

37 

Always to want things 

15 

To do somoLhing I don't liko 

3G 

To ait still 

14 


Tho average distribution for all iteme, in terms of per cent, was: Like 11, Don't 
mind 12, Don't liko 21, Hate 23, and Hate much 33. 
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hate OY /ia(e mud by most of the girta. Also ImviiiK h;if! liuhit.s, biting 
finger nails, or being \uy and forgetful receive the tllsiiiiiniival of many 
girlg. 

Sex DilTevenccs 

A compariaon of the sexes in relation to nnnoyiincf's on 102 itoins 
listed by both groups indicatca Unit girls lire mun)y«l by luoio factora 
than boys and also that they react to a greater di'gveu tliiui tin; hoya do 
to those annoyances, This is especially true in rolaiiim to pmoniil 
conduct. Significant; sex dilTereiiccs show greuler di.dila! by boy.n of 
people who cheat. They arc much more resentful than tlui girls of not 
being able to do as they like. In school, siguiiicnuily mciro boys disliko 
arithmetic and singing, while more girls do not like to liiive nigbtwork 
to do. More boys do not like to sew or to hear their sisteys sing. Sig¬ 
nificantly more gilts hate to bite their finger nuik 

Summary 

A study of children’s reactions to annoyances occuri’ing In sociril 
relationships, home and family, school, and iiersonni cond^ict indicates 
that many situations arc extremely annoying to twelve-year-old clnldvcm. 
Girls are more often and more extremely annoyed tlian boy.s, 

Educational Implications, An annoyance i.s an iinfavoriildj! attitude 
which in many cases is caught from oblicrs. Sonic of the itonia lisLed 
should not be annoying to the normal child. People who arc eonsLauLly 
irritated by every little thing rcllcct a failure to adjuat to tludr environ¬ 
ment. "They can’t take it." On the other hand, a Riauco at many of 
the items listed in the tables suggests definite social HlundardH whioli 
have been accepted by the children. Being annoyed liy imti.soeifil con¬ 
duct reveals the acceptance of favorable group attibude.s and leads to 
adaptation to the social group. But when chiUlveu respond unfavorably 
to many unimportant situationg, they should be taught to ignore those 
factors and not be disturbed by them. However, we should avoid ns 
much as possible constant and unnecessary irritation. Thi.g i.s vital in a 
time when the human organism is being worn out by many indtatioii.g, 
fears, and worries. 

Jicceiued January 20,19^. 



A School Survey of Eyc-Hoad Dominance 
Gertrudo Ilildrctli 

Unrnrr A/arni“/.jHni|n .SVhnn/, <!olumhia Univcrsily 

Tilt! liHinf iH \vi(|('‘i|in‘inl IlitU iiiixi'd i'yr-)inii(t dtmilrmnrp., llinL Ih, tlio londcncy for 
aye null liuiiil prcfcrriii'r tu hi! o|i|h>mHi* Hided, Ih n emiunof muliii^^ diHuhiliLy, nervous* 
iicas mill linhftviiir priililcnirt, Tlif’ riKld-hiiiidcil idiilil wiio is IcfLreycd or vko vcrsti ia 
(i‘«Biiiiir!(l til liuvi! mnrii clifliniRy in l<‘nriiiii(' l« read nud in nmkitip Kfitinfactory pcrsoiinl 
ndjii.sl.mcnl'!!, lie h liclicved mirror wrilc more (Imn llic individiinl ivhoiic eye and 
Imiid (Idiniiuinci! nro likn-uldeil. A |iiironl rncoidly inqiilrnd, "Isn't iny chiUl'a reading 
difliiiiilty dun In llie fm-t Hint lesb hIiow hIic la left-eyed?" Tlio nnUon is also prevalent 
tliat mixPiJ cyn-lmnd dnniiimnce in n rare oeciirrencc in the general population, 

A imnilicr of iiuIiUhIiimI hIuiHoh have given snincwlml conlljcLing results, The present 
sliidy was unilerlaken to oldtdn addilioind evidence on the subject, to dcLermino tlio 
incidence of mixed dniniriiuu'i! in an entire elomeiitary hcIiooI population and the nsRo- 
cliition beUveen inixcd dniniiiance and rmdiiiR dianhilily in the Hnme population. 

IleHiillH of Trovioiw Studies 

Incuknco of Uft-l']ye(lnm and Afixed Dominance. Piii-son (8) re¬ 
ported HO per {lent left-ojMidneKS, 12 per cent irnijartinl, nrid 58 per ceab 
viRht-cyotlneHfl iti a normal hoIkm)! population in which left-handedness 
was prcHent in iihouC four per cent of the cases. Solzer (10) found 32 
per cent of (Ki children in the damhridfic fichools, Grades II to YI, to be 
left-cyc’d; 72 per {m'iiI of tiie l(‘ft-haiulod cliildren were IcfUeyed. Schonell 
(9) investifijaLed the relation between eye and hand dominance in 75 
school cinl(li'(‘ii, with the following results (Il.H. and R.E. signify right 
hand and right eye Vesiieetively); ll.ll.—R.E., 00%; R.H.—L.E,, 25%; 

L.E., '1%; L.II—R.E., 0%; R.H.—and either oye, 8%; and 
L.H.—and citlier eye, 0. 

Mixed Do?nitiance and Reading Disahilily. Johnson O'Connor (7) 
reported an unusual amount of uncoordinated motion, twitcliing, shifting 
of position, speech irregularities and rending troubles among those who 
tested left-cyed and right-handed. He found less trouble among tliose 
whose InindediKi.ss and (!ycdiic.ss agreed. A study by Mintz (5) indicated 
more mixed doiniiifinco among .siilmonnal than among normal children. 
Monroe (0) reiiorled that '13 per cent of the reading di.salrility cases she 
studied sliowcid mixed dominance. I'crnnld (1) reports on the problem 
as follows: "Tlie i-ight-handcd ca.scR and the coses of matched eye-hand 
dominance resemble the casea in which the dominance is not matched, 
are as serious in their deliciency, learn by the same methods, and are as 

83 
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successful in tlie final outcome.-The Bubjecfc with unmatched eye 

and hand dominance learna to read and is able to read in an entirely 
normal manner mtli eye and hand dominance still oppo.Hite.” Gate.s 
and Bond (2) found little association between eyedness, handedness and 
reading achievement. JolmBon (4) reported no significant relationship 
between lateral dominance and reading disability. Wile (11) found 
among children showing reading disability, 02 per cent ieft-oyed, 8 per 
cent uncertain or mixed, 30 per cent right dominant. There is no indi¬ 
cation as to how many of these pupils were lcft-l\anded. Witty and 
Kopel (12) found 33 per cent left-eyed in a group of poor readers, 31 
per cent leftreyed in the normal reading, non-problem group, Wolfe (13) 
reported that more normal readers than retarded showed dominant Icft- 
eyednesa on a sighting test and the groups were found not to be dis¬ 
tinguished by handedness or a combination of oye-liand dominance. 
However, the retarded proved to be inferior in auditory functions, visual 
perception and emotional adjustment. 

A School Survey 

Hew evidence on the question was obtained through survoying an 
elementary school population consisting of 101 boy.s and 90 girls from 
kindergarten through Grade VI. The ago range wa.s from 0 to 11 with 
two children who lacked a month of being 6 and two wlm had just turned 
12. The population rated above the average in general ability us meas¬ 
ured by standard tests. Because of the selected nature of the population 
there were no cases in Which reading disability could be attributed to 
lack of.learning capacity. 

Tcfifs of Eye and Hand Dominance. Each pupil was given individual 
teats of eye and hand dominance. Four tests of eyo dominance were 
used as follows; 

1. Sighting dot. The child's atteatioa was called to a black dot on a card 
taoked on the wall, He was told to stand with toes on a line marked on the 
floor three feet froto. the wall. The dot was placed at ©ye level. The child 
was given a box lid in the center of which was a half inch hole. He was asked 
to hold the hole at arms' length with both hands, be was told that one oyo 
would be oovered, then the other and that the dot would probably disappear 
when one eye was covered. The examiner oovered each eye in turn, witli a 
Biaall card, asking the child to state whether he could or could not still aco tho 
dot. The eye with which he could still see the dot when one oyo was covered 
was recorded as the dominant oyo. 

2. Sighting iuith the Parson manoptoecope, Tim child was asked to stand 
on a line two feet from the wall where the Parson board with red ball in be¬ 
tween the letters L and R was hung up at the right height for hie aizo. He 
wee given tho aluminum cone, was instructed to hold it in both Imnda, his 
attention was called to the red ball and he waa instructed to fixate the red ball 
as he looked through the cone. Then the examiner explained that one letter 
could be seen alongside the ball, end the ehild was asked to state what letter 



A School Survey of Bye-Hand Dominance 


S5 


he could Hdo. TIiib letter was recorded. For the youngest children, small 
pictures of a dog and cat were used in place of the letters L and U. 

3. Sighling dot with the Parson cone. The child standing two feet from a 
card with a block dot held by the examiner, was asked to fixate the dot through 
the aluminum ooiie, Tlio position of (he aperture of the cone with reference 
bo an imaginary vertical line drawn through the child’s nose was recorded. 
If to the right of the imaginary lino, the child was recorded aa right-eyed; if 
to tlio left, loft-oycd, 

4. Peep Show. The child was shown an imitation Easter egg with pictures 
inside that could \)0 seen by looking through a quarter inch aperture at the 
smaller end of the egg. The examiner held tho egg in both Imnds while the 
child studied and reported on the picture. The cyo used in fixating the pic¬ 
ture was recorded as tho dominant eye, 

A test was repeated if for any reason results were not clear cut, In the 
first tlirce, the chikl kept both eyes open. 

Only the fourth test in which the examiner rather than the child held the 
materials could bo said to bo entirely independent of handedness influence. 

Determination of dominant oycdneiia was more diflicult and probably less 
relial>le in the case of younger children because of their difficulty in complying 
with instructions and their concern with irrelevant features of the test situation, 

Teels of Handedness. Handedness was tested in three ways: 

1. The child was requested to pick up a pair of scissors and to cut a corner 
from a piece of paper. 

2. He wa.s asked to write his name on the paper. 

3. He was asked to pick up and toss a ball to the oxaminor several times. 

These three tests alTord a sampling of single handedness activities rather 

than a complete survey of each pupil’s handedness habits. 


Table 1 

Ilcaults of Eye and Hand Dominance Testa in an Elementary School Population 





Eycdneaa 




Handedness 



Ago Level 

411 

4L 

311 

3L 

2II-2L 

311 

3L 

2R 

2L 

Cases 

6-6 Years 
Number 

10 

8 

2 

2 

2 

20 

2 

1 

1 

24 

Per Cent 

42 

33 

8,3 

8.3 

8.3 

83.3 

8.3 

4,2 

4.2 


7 Yearn 
Number 

13 

6 

3 

2 

2 

22 

1 

1 

2 

26 

Per Cent 

60 

23 

11.6 

7.7 

7.7 

86 

3.8 

3,8 

7.7 


8 Years 
Number 

10 

10 

1 

2 


20 

3 

2 

1 

32 

Per Cent 

60 

31 

3.1 

0.2 

— 

81 

0,4 

6,2 

3.1 


0 Years 
Number 

14 

0 


1 

3 

26 

1 

_ 

__ 

27 

Per Cent 

62 

334 

— 

3.7 

11.1 

06.3 

3.7 

— 

— 


10 Years 
Nvimber 

27 

8 

4 

2 

1 

34 

4 

_ 

4 

42 

Per Cent 

04 

10 

0.6 

4,8 

2.4 

81 

0.6 

— 

0,5 


11 Years 
Number 

12 

16 

3 

6 

5 

36 

2 

1 

1 

40 

Per Cent 

30 

37,5 

7.5 

12.6 

12.6 

00 

6.0 

2.B 

2,6 
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Indications of Reading Achievemnl. Objective test rccor<lfl, for the most 
part Stanford Achievement reading scores, or compnrnblD diitn, were nvnilnblo 
for each pupil. Those who scored a year or more below grade median in the 
primary grades, a ycor and a half or more in the upper grades were considered 
disability caaea for purpoaea of this study. Teachers’ e.stiinntcs and the neces¬ 
sity for recent remedial instruction in rending served as additional criteria in 
selecting the poorest readers in each class. 

Results 

Table 1 shows the number and percentage of pupils in each ago level 
who were totally or partially right- or left-eyed, totally or partially 
right- or left-handed on the seven tests given. The right-eyed children 


Table 2 

Results of Eye end Hand Dominance Teals ehowing the Relationship between 
Eye and Hand Dominance 


Age Level 

Mixed Eye~Hand Dominance 
R.H.-L.E. L.H.-R.E. 

R.Il.-R.E. 

L.n.-L,E. 

5-6 Years 





Number 

7 

1 

11 

2 

Total number mixed 

8 




Total per coat mixed 

33.3 




7 Years 





Number 

a 

3 

14 


Total number mixed 

n 




Total per cent mixed 

42 




8 Years* 





Number 

8 

1 

20 

2 

Total number mixed 

0 




Total per cent mixed 

28 




6 Years 





Number 

0 

_ 

14 

\ 

Total number mixed 

0 




Total per cent mixed 

33.3 




10 Yenre 





Number 

7 

3 

27 

4 

Total number mixed 

10 




Total per cent mixed 

24 




11 Years 





Number 

20 

3 

12 


Total number mixed 

23 




Total per cent mixed 

57.5 




Per cent mixed all age 





levels combined; 

30.0 





The record for tlifi only pnir of twine: 

Eyednesa Testa Handedness Tesla 


1 2 3 4 1 2 3 
R B R R EUR 
^ b L L R R R 


Girl 

Boy 
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wero more coiiHiHtently rifthtreyed in the four eyedness teats than were 
the Icft^eycd cliildren. It was mthcr Burprising to find a substantial 
number of tlie nghl-oyad children writing with the left hand 

There was no clear cut or consistent developmental tendency from 
one age group to the next. Sec Table 2. Although numerous research 
studies have shown a decrease in dominant Icft-hundcdncss with age, 
and a slight tendency toward decreasing left-handedneas was found in 
these reaults, no sucii decrease was shown in those data for eye-dominanco. 


Table 3 

Eyo-IlBnd Dominrvnco Data for tho Slowest Hoadere in Eooh Ago Group 


Ago Level 


Boye 


Girls 


Uyedneaa 

Haiidcdncaa 


Eyeclness 

HandccIncsB 

7 years 

Coao 1 

4R 

3R 


_ 

_ 


Case 2 

4L 

3R 


— 

— 

Sycarfl 

Case 1 

4R 

3L 

Case 1 

4L 

3R (foreign 







child) 


Case 2 

4R 

SR 

Cnao 2 

4R 

3R 





Cose 3 

4L 

3R 

9 years 

Cnsol 

4L 

3R 

Cose 1 

4R 

aR 


Case 2 

4U 

3R 





Caeo3 

3L 

3R 




10 years 

Case 1 

4L 

3L 

Cose 1 

4R 

3R 


Case 2 

4L 

3R 





Case 3 

411 

3R 





Case 4 

4R 

3R 





Cqsd5 

3I^1R 

3R 




11 years 

Case 1 

3R-1L 

3R 

Coao 1 

2R-2L 

3U 


Case 2 

4R 

3R 





Case 3 

4R' 

3R 





Cose 4 

3R-1L 

3L 





In fact, the eleven-year group showed an increase in left-eyedness over 
tho ten-year group and more inatability on the tests in general. The 
same situation did not prevail in the handedness test results for the 
eleven-year group. This may bo a chanco rtjsiilt due to the small popu¬ 
lation or it may be an indication of instability appearing with the ap¬ 
proach of puberty. 

Eye-Hand Dominance and Reading Disahilily. Twenty-two coses, 
sixteen boys and six girls in the entire group of 191, were selected as 
reading disability cases, according to the criteria given above. These 
pupils were all seven years of age or older. Table 3 shows the results 
for each age level in terms of eye-hand dominance. 
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Of the boya, there were eeven or 44 per cent of the casoa \vho showed 
mixed eye-hand dominance; of the girls, three or 50 per cent wlio showed 
this condition, a total of 45 per cent or less than half of all imling ilis- 
ability caaca, The number of cases is too small to indicate reliably that 
these reading disability cases showed more tendency toward mixed domi¬ 
nance than the normally successful readers. 

Although a somewhat larger proportion of mixed doniinaut cavsea had 
difficulty with reading than consistent dominant pupils, fiinoo fewer than 
half the mixed dominants were slow in learning to road, the conclusion 
must be drawn that mixed dominance is not a prevailing condition in 
reading disability, far less a dominant (sausal factor in the inajority of 
disability cases, 

Received Decenibef fO, 1949. 
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rifthn, EugGne F, Slultering, significant theories and ihcrapies, Pnlo 

Alto: Stanford University Presa, 1943. Pp, ix -|-177. $2.00. 

Professor Halm has presented a compendium of theories and therapies 
of 25 of the “authorities in the field.” Ho does not state tlie basis for 
his selection of flpecialiflts, altJtougli tho list appears to be representative 
of the major educational and medical clinics doing research and thera¬ 
peutic work on stuttering in this country and abroad, and to suggest the 
great variety of ways in wliich the problem ia studied and treated. Since 
the several reports average less than six pages each, they are necessarily 
sketchy and incomplete. The author’s purpose of facilitating compari¬ 
sons of the philosophies and therapeutic procedures involved is inherently 
limited by this re.striction. The careful student will want to go to origi¬ 
nal sources. The beginner may be more confused than enlightened by 
the multiplicity of points of view presented. 

Each summary is divided into sections on Theory and Therapy, 
While moat Bpeoialiata appear to have been impelled to evolve a unique 
theory of stuttering, the careful reader will detect a considerable amount 
of Bimilarity, under the verbiage, used to explain many Of the theories. 
Some are certainly much more closely in line with modern psychological 
fcJiinking than others. One of the values of the theory is no doubt tho 
suggestion to tho patient that tlie clinician is an expert. Anyone who 
has such a plausible explanation of the difficulty would surely appeal to the 
afflicted as a desirable person to administer treatment or direct his study. 
There ia no indication that clinicians have consciously evolved their 
theories for this purpose. The multiplicity of theories is suggestive of 
the early reports to The French Academy of Sciences on the origin of 
language. 

The Sections on Therapy appear to this reviewer as more significant. 
While few clinicians claim univerBol “curea” the success reported with 
such widely divergent treatments indicates either that stuttering is a 
malady of many causes and tlrerefoio subject to many treatments, or 
that there are common therapeutic values often overlooked in the various 
types of therapy, and not explained as such in the theory. 

An Appendix of fifteen pages prepared by the author and entitled 
“Procedures in a Clinic for Stutterers” is a gesture toward unification of 
the various points-of-view of the “specialists.’' Within the limits of 
space used, this appears to be one of the better features of the book. 

88 
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Tlie book focuses attention on gvcat vivtiety ot huc-kgvouiKlti awl 
approaches to the malady by those who ore “iiuthorilicH in the lield," 
and leaves the reader with the reaUmUon that there is still much research 
to be done. If this book serve-s as n stimulus lo fiirlhcr rrseavch and 
unification of thinking in tlio field, it will make an iiaportimt contvilmtion, 
This reviewer does not believe that the book will serve us sucli a stimulus, 

Friuikliii II, Knower 

The Stale UniversHy of Iowa, 

Department of Speech 

Cole, Luella. Attaining maturity. New York; Farrnr and Ilinelmrt, 
194d. Pp. X + 212. $2.00. 

This treatise is concerned with prohlcma of adiusUaent in tlic niodern 
world, Both in ordinary times and in timc-s of tliei e arc always 

individuals who cannot adjust to complexities of life. Some of these 
never progress beyond childish attitudes and adolescent whims. Otliers 
regress to this status in trying timea. In other words, Huch people never 
grow up, i.e.j attain maturity. The mature individual is relatively free, 
he finds contentment and he feela secure. After noting the need for 
maturity, the author discusses the criteria of intellectual, emotional, 
social, and moral maturityv Popular escape is by fuutuKy, play, .solitude, 
fanaticism, projection, sophistication and illne.ss. SulutioiiH for the ma¬ 
ture person are briefly outlined. Tlic final section i.s eoncorned with 
maturity and the war, The book contains many cnliRlUeninR examples. 
Both the case studies and the discussion are well organW.ed aid in iu\ 
analysis of acute problems of adjustment. Aa a guidebook for those 
seeking to attain maturity, however, the treatise is less adcQuato, There 
are a few ill-considered statements such aa “the madhovisc yawns for 
those who cannot be emotionally toughened" in war situiition.s. Never¬ 
theless the book hag much to recommend it as "a guide to living with 
yourself and other people." 

Miles A. Tinker 

The University of Minnesota 

Kingsley, Donald J. [Chaii'man], Recruiting applicants for the public 
senice. A report submitted to the Civil Service Assembly by the Com- 
miliee on Recruiting Applicantafor the Public Service. Chicago: Civil 
Service Assembly of the XJ. S. and Canada, 1942, Pp. xvi -f- 200. 
$3,00. 

This volume sponsored by the Civil Service Assembly of the U. S. 
and Canada is another in the aeries dealing with the major phases of 
public personnel administration. The report is the work of J. Donald 
Kingsley aided by a committee contiating Fred Zapolo, Hussel Bartbell, 
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Irving Gold, George C. Brown, Williftin Howell, George H. Halsey, and 
Edgar B. Young, iiniong others. 

The treatment of tho subject matter enn be subsumed under four 
categoric.^ or topics embracing six clmpters: (1) hi.storical iintccedcnts of 
public service recruitment, (2) the nature of recruitment and recruitment 
procedures, (3) determining and forecasting personnel needs, and (4) 
application prooedure and audit. 

The content of the report is sumniarizcd as follow.s: Traditional con¬ 
cepts of recriiitinent iir(5 inadeciuatc and have generally failed to produce 
a meritorious public service. The assumption that “keeping the rascals 
out”—a reaction to the spoils system—would of itself establish an ade¬ 
quate public service has been shown to be incorrect, and in fostering,a 
laissez faire attitude in rogaixl to recruitment, has resulted in a failure to 
attract men of superior ability to the public service. Kecruitment should 
bo positive in approach and nltould bo to the lower levels of integrated 
classes of positioua with promotion to higher levels. vSucli recruitment 
should occur at an early age and tlic point of entry into the service should 
bo rolatod to tho educational syatem. The institubion of those prin¬ 
ciples coupled with flexible transfer and promotion would give rise to a 
career system attractive to men of ability. Assumptions of such a career 
syatem arc that adequate techniques for attracting and selecLing recruits 
are available, and that high prc.sfcigo value exists for the pul)lio service. 

Hccruitment is defined tvs “that process through which suitable candi- 
date.s arc induced to compete for appointments to the public service,” 
Tho first step in the process is the determination of present and future 
personnel needs ns a basis for planning the recruitment schedule. Such 
forecasting reduces the need for provisional appointments and serves to 
coordinate the recruitment, selection, and certification programs. Per¬ 
sonnel needs may bo determined from many aource.s but among the most 
useful arc departmental dcmniuls for new personnel, personnel records 
and turnover statistics, analysis of departmental budgets, and surveys of 
employees for promotional possibilities. 

There are two kinds of recruitment: anticipatory and direct. The 
former consists of building up favorable attitudes toward the public 
service without regard to any pai’ticular examination but with an eye to 
remote recruitment; the latter is the specific scarcli and location of an 
adequate number of applicants for u specific cxaniination. 

Examination announcements are employed in direct recruitment to 
attract and interest qualified persona in examinations, to inform them 
of the nature and conditions of employment, and to discourage unqualified 
persona from applying. However, examination announcements are not 
equally suited for these functions and should only be employed for indi- 
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viduala already interested in public employment. Wliero legal require¬ 
ments are not restrictive, examination publicity should be of a variegated 
nature and in line -with principlea of modern ndvertiBing. Announce¬ 
ments should be made more attractive and more care given to their 
distribution. 

Admission to competition is invariably by application. This process 
involves the construction of an application form to secure the appropriate 
facts administration of the application, determination whether minimum 
qualifications are met, and notification to the applicant of admi.ssion or 
rejection. The governing principle in application proccduro is that only 
those items related to successful job performance, or statutory require¬ 
ments, should be contained in the application, and audited in a manner 
most conducive to the determination of qualification or the lack of it. 

Principal deficiencies of current recruitment procedures arc: (1) un¬ 
imaginative and stereotyped recruitment, (2) tendency to conform to 
legal minima, (3) absence of objective information upon which to base a 
sound selection program, and (4) a lack of planning and basic research. 

The value of this report lies in its sound outline and treatment of the 
general problems of public service recruitment. It is not intended oa a 
palliative indicating how more nurses, aocouatanta, or social workers may 
be recruited in the war emergency but rather presents a number of prin¬ 
ciplea upon which an adequate recruilanent program should be based. 
This seems a wise departure for it is doubtful at best whether any volume 
of this scope can solve the problem of tecruitment without a basic rc- 
lorraulation of governmental and administrative policies. Although the 
report is by no means novel in its recommendations, following closely the 
earlier studies of Professor Kingsley and the Commission of Inquiry on 
Public Service Personnel, its restatement is so fundamental as to make 
it mandatory reading. Nor does this detract from the excellent diecus- 
sion of application procedure which comprises the second half of the book. 

Of specific merit ia the atress placed upon the need for research and 
objective information regarding boric recruitment and selection prob¬ 
lems, The reiterated objections in die book to provisional or temporary 
appointments and the emphasis on forecasting of personnel needs as a 
corrective measure ia wholesome. Of con^quenco also is the objection 
to long and involved application forms where the information requested 
has no relation to job success. Following industrial practice, applica¬ 
tions should contain only those items that are of predictive significance 
in placement, in addition of course to those required by statute. 

It is the reviewer's opinion that the career system as a cure-all for 
the recruitment problems of governmental agencies has been overatressed. 
Granting for the moraent the aaaumpUong of prestige for the public 
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fjervice and adequate selection and recnutment techniques—by no means 
safe assumptions—liave not other factors been overlooked; c-g., compe¬ 
tition of industry, business, or the profeasiona; opportunities for higher 
salaries or profits wliich public juriadictions could not hope to meet; the 
fact that uii unknown quantity of individuals may not be interested in 
a life career in one agency or locality. Attraction of individuals to 
employment is always based upon a complex of factors of which the 
opportunity for a oavecr ia a variable weighted in varying degrees. 

There is furthermore something to be said for recruitment of special¬ 
ists at higher tlmn the entrance level. Public jurisdictions are limited, 
and will remain limited by their very nature, in the scope and amount of 
training they can provide career neophytes in a large and varied number 
of occupations. Such training con usually be given only in professional 
and technical schools at considerable expense. Selection of numbers of 
recruits on the basis of appropriate aptitude may well be an insurmount¬ 
able task for such a diversity of aptitude teats do not exist and public 
personnel aptitude testing is even less advanced than subject matter or 
achievement testing, Nor can a probationary period substitute for 
inadequate selection. The concept of a eareet ayatem is laudable when, 
due consideration is given related faefcora in recruitment. 

Arthur Burton 


Calijctfnia Stale Peremnel Board 
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The Role of the Psychologist in Market and 
Advertising Research * 

WftUace H. Wulfeck 

The Federal Advertising Agencyt Inc,, Nm yorfc City 

Psychologists, genemlly, have been trained for the work of the lab¬ 
oratory, clinic and classroom. These places have been their occupa¬ 
tional milieu. With the exception of the few, who in late years have 
been working in the field of business and industry, not many arc ac¬ 
quainted with the actual details, the scope, or the wide variety of interests 
which make up the business p^ohologiats^ day. This paper will try to 
provide' an insight into these processes. It will (a) take a quick glance 
at the rapid expansion of psychology's contribution to industrial and 
business development during the past ten years; (h) make mention of 
some of the personalities who have played a part; (c) give a job descrip¬ 
tion by examples; along with (d) a prediction of the place of psycho¬ 
logical research in the present and post-war economy. 

Much of the discussion wfll be centered around the work of the 
Research Director in an advertising agency. This presents no particular 
limitation because most agencies serve a rather large list of accounts, 
representing a broad sample of manufacturers. In our case, it runs from 
corsets to railroads and touching such products as food, drug sundries, 
cosmetics, clothing, sanitary protection, pencils, magazines, baby food, 
heavy industry, and the emergency recruitment of farm and food proceas- 
ing labor. The agency research service reaches deeply into the areas of 
production, labor, and distribution of many of these clients as well as 
investigating their advertising problems. Consequently, agency research 
is in reality industrial and business research. 

We will not become involved here with the broad speculative prob¬ 
lems concerning the economic justification of advertising, or the kind of 
political-economic organization wliich should, or will, exist following this 
terrible catastrophe. We can only assume, as most politico-economic 

• Read at the February 1944 Meeting of the "New York State Asaociation lor Applied 
Psychology. 
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prognoaticationa auggestj that there will be no fundamental change in the 
industrial organization of this country except perhaps for a continued 
exercise of limited governmental control over the practices of busineaa 
and industry. One needs only to read Stuart Chase; Whe,rc*s the money 
coming Jromf' to realize the kind of a world we will live in and the 
collossai obligation of a controlled capitalism to maintain oconomiil 
security for ^'We The People." It is the continued existcnco of this kind 
of a world which provides the occupational challenge for psycliologists 
now end tomorrow. 

The date at which applied psychology first gained a dawning recog¬ 
nition is debatable. For convenience, it may be placed around 1915-16 
when Porter began publication of the Journal of Applied Psychology, or 
more speciOcally with the pioneering work of such men as Harlow Gale, 
Hugo Muenaterbei'g, H, L, HoHlngworth, E. 1C. Strong, and W. D. Scott. 
However, ita great commercial impetus came much later in the buaineas 
field following the developmental and promotional work of Link, Starch, 
and Gallup, among others. These men refined and expanded the now 
powerful methods known as marketing, public opinion and advertising 
measurement which have become useful tooU in a wide field of socio- 
psychological, economic and military euterprises. Perhaps it is fair to 
say that by 1933 these methods and the national organizations to employ 
them effectively were reasonably wdl establighod. 

The wide-apTead acoeptauce of these and related methods has come 
only within the past ten years. In that brief span the growth has been 
phenomenal. The men and women recruited for this work came to it 
from many varied backgrounds and traiiuDg. Almost none of them had 
training or experience in business, radio, or advertising. They brought 
to it one important element for success and that was a training grounded 
in scientific method, and a belief in ita usefulness for solving tho peculiar 
problems of business so far removed from the interests of the laboratory. 
Often they entered this field with grave misgivinge, as though these fields 
of work were not a valuable or essential part of the life of our times, or 
would not allow uninfluenced freedom or scientific honesty in research. 
Notwithstanding, they came. Today thelfat of these people is formidable. 

Who They Are 

Here are a few of them taken from the membership lists of the A.P.A. 
and A.A.A.P. This list is by no means complete, and no one has been 
omitted with intent, A fairly large group have found their way into the 
services, There are two who have the M.A, degree, tho rest hold the 
Ph.D. 

^ Nev? York, 1943, The Twentieth Contury Fund. 
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In Advertising Agency Research. George Gallup and Sam Hayes of 
Young and Kubicam, Otto Tinkelpaugh of J. M. Mathea Co., John B. 
Watson of Esty Co,, Albert Blankenship of N. W, Ayer, Ernst Dicliter 
of J. Sterling Getchell (now in radio), Alfred R. Root, and A. C. Welsh 
of Knox Reevea, Jean Pasmanfcicr and W. IL Wulfcck of the Federal 
Advertising Agency. 

With Inde'pcndcni Research Organizalimis. P. S. Achillea, Henry C. 
Link, Albert D. Freiberg, George Bennett, P. G. Corby, Eleanor Barnes 
of The Psychological Corporation; Daniel Starch of Daniel Starch Asso¬ 
ciates; Raymond Franzen and George Gallup of the Institute of Public 
Opinion. 

Doing Radio Research. Frank Stanton, Ernst Dichter of the Colum¬ 
bia Broadcasting Company; Matthew Chappell with G. E. Hooper; 
Sidney Roalow, The Pulse of Now York; Paul Lazarafcld, and Robert H. 
McMurray. 

In Government. Renais Likert, and others. 

Consultants. There is an important group of business, media, and 
radio research men holding faculty positions, among them D. B. Lucas 
and John Dollard, Readership; John Peatman, Radio; Hadley Cantril 
and Harry II. Field, Public Opinion; Arthur Kornhaueer and Floyd 
Ruch, Marketing and Advertising; Harold E. Burtt and Howard P. 
Longstaff, Advertising. 

It will be noted that two of those named are women recently come to 
this field. The work is wide-open to women having the interest, training, 
and personality for it. 

Among business reaenreh leaders, psychologists tend to predominate 
05 a professional group, but there arc men from many other scientific 
disciplines holding prominent positions. They inolude economists, engi¬ 
neers, sociologists, and even chemists, Yes, psychology has made a 
place for itself in these fields even though it has failed to hold a dominant 
position in industrial and peraunnel work. Apropo,s of this Inst remark, 
it must be said in ail fairness tliat the recently developed clinical ap¬ 
proach to employment and personnel problems has stimulated new 
interest on the part of management, which may change the status of 
payohologiafca in industry. 

If they arc not already obvious, the r^ons why psychologists enter 
the business research field we similftr to those for doing any kind of 
clinical or experimental work, 

1. As you will Hce, the probloma are inhorcntly interesting in them¬ 
selves, as iiitcresLing as raony reported in the current psycliological 
literature. 

2. Often the results have important economic, political or social value, 
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3. The rewards to tlie individual in antisfaction, rerognibion, and 
remuneration are equal to, if not greater than, those which accrue from 
work in other fielda of psychological endeavor. 

If you are to get a "feel'’ for the kinda of things these pco]3le do, the 
types of problems they attack, the scope of their operations, ^vc can do 
no better than examine in outline a few of the projects atuiliod by the 
research department of one agency during tliG past year. Those prob¬ 
lems are speoiBc and representative and by no means exhaust the possi¬ 
bilities. Nor do they do more than indicate the ramifications of research 
in radio, marketing, and public opinion fields. 

Examples of Jobs Done 

First, it is well to know how the work is broken down into functional 
operations, There are three related types of investigation: 

1. The application of psyoholopcal knowledge and reaenroh to the 
creative technique,s in making effective advertising bccnu,se the fiincfcion 
of advertising is psychologic as well as economic. This iucUides evalua¬ 
tion and measurement of copy appeols, lay-out, art, and media. It tries 
to answer the question, "What ra the most effective way to prcacut the 
values in a given product so that the messago will penetrate the minds 
of the consumer, become a part of his memory equipment, and result in 
persistent purchasing habits?" 

2. The use of consumer survey methods to investigate product ac¬ 
ceptance or rejection, penetration of advertising appeals, public nttitudey 
toward business as a whole or aome speeific industry, opportunities for 
new markets, consumer buying power and preferences, rcadersliij) of 
magazines and newspapers, and radio listening habits. 

3. Library research—analysis of aules and distribution data, analysis 
of coverage and audiences of varions media, study of tlie lai,vs and regu¬ 
lations governing advertising, verification of claims made or to be made 
in ads, seeking and documenting incidents, events, personalities, and 
ideas to be used in advertisements. A multitude of other services, too 
numerous to mention, fall into this category of work. 

Now to illustrate with, specific examples tire ways in which these 
types of research work out in fact. Projects "A" through "D" exemplify 
the first type of investigation. 

Proicct A, You are aware of the existence of a group of mugarunoa 
called the "Women’s Service Books" written expressly to women. Those 
magazines are advertised to advertised just like any other product. 
Obviously the advantages in reaching a feminine audience with a product 
story in this type of publication, as against tho general audience media, 
resides in the known fact that the interests, attitudes, and needs of 
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women nre different from those of men. In order to specify and drama¬ 
tize these diffcrencea, an iiiveatigation was begun to canvass known differ¬ 
ences in interests, abilities, attitudes, and achievement between the sexes, 
This study necessitated a search of the biological, sociological, anthro¬ 
pological, and psychological literature to estnblisli a factual basis on 
which an advertising campaign could be built 

Project B. An investigation of the sexual attitudes, myths, preju¬ 
dices, and taboos of women members of various religious faiths and sub¬ 
cultures wliicli motivate against the use of tampons for menstrual pro¬ 
tection—accompanied by a study of the types of advertising appeals most 
likely to combat tliese resisbanceg. 

Project C. The pre and post appearance evaluation of copy appeals 
through the use of consumer jury tests, consumer panels, split-runs, test 
city campaigns, coupon returns, and readership studies. 

Project D. The use of Oloo-margarine has become a war-time neces¬ 
sity. In order to increase the use of this product, it was necessary to 
discover the hoiisowifc’s attitudes, botli favorable and unfavorable, 
toward its u.so and traii.slato the information into nn educational cam¬ 
paign to change her food use habits. Because of food scarcities and 
rationing this procc.ss has been carried on for many products, cereals for 
example. 

Three Idnd.s of invc.stigation which characterize the second typo of 
researcli follow: 

Project Fj. One of the irksome problems of logistics wna the protec¬ 
tion of ordnance and machinery from corrosive moisture during storage 
and sliipmont, The method in general use was bo immereo the inatcrials 
in oil or grease, Tliis was both time consuming and expensive. Scicn- 
tista, put to work to develop a more practical device, discovered a com¬ 
pact crystalline eliemical absorbont which could be packed along witli 
the material in a sealed plio-filtn envelope. It was a simple, bub com¬ 
plete solution. 

The manufacturer of this product soon realized its value for de- 
humidifying jjurpo.scs in homes and indu.stry. It will be among the 
many new products available to make our living more comfortable in the 
post-war era. Our i)rnblem i.s to discover its potential u.ses in home and 
industry. At thi.H moment liundreds of home.*? in the high Immiclity belt 
are exp(irim(!niing with samples of the material and will loll ns what it 
will do, liow it Clin bo u.scd, how they like it, where it should be sold and 
lor how much. 

Project V. The ro.soarch engineer of one of our clients was asked to 
develop a more accurate and sturdier device for the measurement of 
extreme temperatnrc.s in aircraft cirgine.s. Although the method cannot 



be revealed, he employed a simple electrical principlo in making a new 
thermometer bulb which gives precision and hardincas characteristics far 
beyond the rigorous Bpecifications set for it, Tho device may revolu¬ 
tionize remote temperature control. Our job is to investigate its possible 
uses in post-war industry, especially in tee chemicivla, plastics, and food 
processing industries, and to estimate its potential market, 

Project 0. Package design is an important clomonk in the readiness 
with which women will buy a product. Given tbreo different designs 
for a disposable tissue oontainor Bubmitled by a famous de,signer, which 
one will women bo most likely to buy and wliy? Using a paired-coin- 
parigon method, we asked a representativo sample of women and got tho 
answer. 

As a sample of the third olass of research hero are two typical ap¬ 
proaches. 

Project H. War has brought many critical problems to the stocking 
industry, Problems of new synthetic yams, new methodg of manufac¬ 
ture, new styles, price control, and limitation on production. Millg have 
gone out of busincBS and branded Hues have lost position. These factors 
will have profound effects upon the structure of the bueinesa following 
the war. In order to prepare for any eventuality a client commissioned 
us to make a complete analysis of the industry covering factors effecting 
maclunery, production, labor costa, salffl, styles, and methods of distri¬ 
bution, pricing, merchandising, and advertteing. This could all be done 
at a desk and is what we call library i*esearch. The resulting data, 
coupled with informed guesses baaed on experience, led to the formula,- 
tion of several alternate plans or policies of operation which might be 
put into effect in the post-war era, depending upon the prevailing 
conditions. 

Project I. No one had ever made a study of the economic impor¬ 
tance and aocial significance of home-sewing to tlie life of the nation. 
The shortage of paper necessitated accurate information on which the 
government could base allocations of paper for the pattern industry, 
for pattema are the blue-prints, the basic tools, used in home-sewing. 
Exhaustive research into this problem revealed some interesting impli¬ 
cations for the utilization of productive woman power, control of infla¬ 
tionary tendencies in the ready-to-wearindustry, and the restraint of tlic 
coat of living for the great mass of wage earning families. We learned 
that more than 100 million garments were made at home during 1943, 
fifty-four per cent more than in 193d. That more tlian oighty-two per 
cent of all homes own sewing machines and that more than 500 million 
work hours were utilized in creative, useful labor, at an unbelievably 
small cost in paper tonnage. These facts arc only a small part of the 
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findings. The completed report makes a tenable case for home-sewing 
as an important influence in the control of a war economy. 

You have had a rough picture of the scope and importance of the 
psychologists’ work in biisinc-ss and industry. True, some of it is far 
afield from applied psychology, but none of it is remote from the appli¬ 
cation of scientific methodology or the study of aspects of human eco¬ 
nomic behavior. The logical next question to be answered here concerns 
the training whicli will beat fit candidates for positions in this field. 

Training for Business Research 

In my opinion the ideal preparation will include scientific psychology, 
business and economic training, and practical experience to develop 
special skills, in that order of importance. The formal curriculum should 
include experimental and social psychology, scientific method, studies in 
motivation and behavior, and statistical methods. Other studies to 
round out the program should include sociology, economics, business 
administration, merchandising and marketing, advertising, and the tech¬ 
niques of marketing and public opinion research. 

Finally a program of internship study of at least one year with an 
independent research organization such as the Psychological Corporation 
or the rc.searcli department of a large advertising agency. With this 
background the beginner will be ready for one of the many junior posi¬ 
tions on the road to a position of major responsibility. 

Poat-War Opportunities 

Today there is a real occupational challenge for psychologists in 
business and industiy. They have a genuine stake in the increased role 
research is to play in industry's program of production for use, and the 
vast problem of reconversion of industry. It seems clear that the major 
post-war problem facing this country will be the prevention of unemploy¬ 
ment. The solution can lie only in increased production of consumer 
goods, for production means employment. Similarly, production re- 
qiiire.'s purchasing power and markets which employment guarantees. 
The development of new markets, the lifting of the American, standard 
of living so necessary for expanding employment opportunities will pre¬ 
sent incren.singly difficult, widely ramified and interesting problcm.s for 
research, 

Business and industry is acutely aware of this condition and is ex¬ 
panding its re.searcli and planning facilities to cope with it. There is a 
rising tide of confidence in the specific contributions p.sychQlogy can make 
to the solution of the many dilemmas facing them. During the past 
few years, independent research organizations have sprung up all over 
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the country^ Bome large industries have organized extensive departments 
of their own, while advertising agencies have exj)finded and strengthened 
their research programs to meet the needs of their clients. In the opinion 
of the leaders, this expansion will continue well into tlic period of eco¬ 
nomic readjustment. 

Continued development will provide the opporLuait}', if tlic psycholo^ 
gists, who are best prepared to direct this work, arc willing to demonstrate 
their interest and ability and to apply their science toward the solution 
of problems affecting the daily life of all of us. 

Received March 19^. 



The Psychological Coiporation Index of Public Opinion * 

Henry C. Link 

The Fauckdogical Corporation, Nm York City 

This is the eleventh in Scries B of the nation-wide studies of public 
opinion conducted by The Psychological Corporation. Series A, gener¬ 
ally known as the Psychological Barometer, was begun in September 
1932, and is now the oldest peiiodic poll of public opinion and buying 
habits in existence. A total of 65 nation-wide surveys with 412,000 
personal interviews has iDeen made in this aeries which is currently being 
conducted quarterly with 10,000 home interviews each. 

Series B was begun in September 1937 and several of the eleven 
surveys have been reported in this Journal. The present survey is based 
on 5,000 personal interviewa made by 437 intevviewera under the direc¬ 
tion of 115 psychologists associated ivith The Psychological Corporation. 
The interviews were made between October 6 and 30, 1944, in 113 cities 
and towns representing a national cross-scotioii of the urban population. 

The exact questions used arc given below, though not necessarily in 
their exact order. Most of the questions were asked of only half the 
eample, or in 2,500 interviews. 


Wages and the Co.st of Living 

Q. "Is your family more prosperous (or better off) today than two years ago, 
leas prosperous, or the eame?'' 


Answorg 

In Oct. 
1041 

In Nov. 
1942 

In Oct. 
1043 

In Apr. 
1944 

In Oct, 
1914 

More proaperoua 

38% 

29% 

29% 

28% 

31% 

About the same 

47 

47 

48 

48 

40 

Less prosperous 

IG 

21 

23 

22 

20 

Don't know 

— 

3 

2 

2 

3 

Total interviews 

2,000 

2,500 

2,500 

2,500 

2,500 


In spite of the increases in the cost of living and heavier taxes, 77 per 
cent said they were as prasperous or more prosperous than they were two 

* To coiisorvG fipacQ and also paper further detaita of sampling and procedure are 
omitted in this report. For full details ace II. C. Link, Tenth nation-wklo experi¬ 
mental survey, J. appl Psj/chol, 19-14, 28, 363-375. Also, to conserve apace and paper 
only the barest explanatory coinmcnta are included with the present results. The full 
report may be obtained by writing toTho Psychological Corporation, 522 Fifth Avenue, 
New York 18, New York. 
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years ago. This increased or equal prosperity, ns will bo seen from the 
following table, is highest among the C nnd D, or tlie large factory and 
wage-earning groups. In these groups, constituting about GO per cent of 
the urban population, over 80 per cent admit to unimpaired pro.sperity. 
Bat even in the predominantly white-collar and executive groups, A and 
B, over 73 per cent admit to continued prosperity. 


October 1044 

Total 

A 

By flocio-Kcon. Groups 

11 C! 

D 

More prosperous 

31% 

28% 

27% 

34% 

34% 

About the same 

40 

40 

40 

46 

47 

Less prosperous 

20 

24 

24 

18 

IS 

Don’t know 

3 

2 

3 

2 

4 

Total interviews 

2,500 

250 

760 

1,000 

600 


Labor Riots va. Race Riots 

Q. "Which do you think will happen most oltcii in tho next two years, raco riota 
or labor riots?" 


By SocioTCcon. Groups 


Answers 

Total 

A 

D 

C 

D 

Labor riots 

46% 

44% 

44% 

47% 

41% 

Race riots 

31 

31 

38 

30 

24 

either 

7 

0 

5 

8 

0 

Both 

3 

0 

2 

2 

3 

Don’t know 

14 

10 

11 

13 

23 


The Roots of Free Enterprise and Post-War Planning 

The individual American and his family constitute the roots of free 
enteipiise, capitalism, and post-war planning. Post-war planning, to 
date, has been primarily a matter of government agencies on the one 
hand and business organizations and groups on the other. Therefore, 
it was decided to devote the larger part of the present BUrvoy to a study 
of the post-war plans being conmdered by individuals. Ho\vever, instead 
of limiting the scope of this planning to articles they wore going to buy, 
our inquiry included the hinds of jobs they were planning to hold or to 
obtain, plans for education and travel, and plana for going into business 
for themaelveg. 

Q. "Ab you know, making jobs tor tho roturning floWiors find mnny othere i.<i going 
to be a big problem, Have you heard or icud about any business organizations who 
Bte pltoming for post-war jobs?" 
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64% answorcd “Yea." 

40% {Lnswered “No.” 

Q. "Ilavo you heard or read of any planning for poaUwar jobs by tho GoverDinent 
or Government bureaus?” 

62% answered “Yea.” 

38% answered “No.” 

Q. “Do you think that planning by the Government nnd buainosa concerns will 
be enough, or do you think that the head of every family and every returning soldier 
should also make a post-war plan of hia own?” 

11% thought this would ho enough. 

80% thought individual plans also necessary. 

0% were uncertain. 

Q. “Have you or the head of your family reads any post-war plana? That is, 
have you mode any plana on how you are going to ubo your war-timo aavinga and bonda 
when the war is over?” 





By Socio-Econ, Groups 


Answore 

Total 

A 

B 

C 

D 

Y(a 

54% 

60% 

58% 

69% 

44% 

No 

46 

60 

42 

41 

66 


Q. “{If Yea in previous question) Would you mind telling me the things you 
and your lamily nro going to do or bay in the order in which you are now planning to 
do them?” 

Answers Total 


Homo, farm, bungalow 22% 

Household appliances 18 

Autornobile 17 

Fumituro and fumiahinge 0 

Trip or vacation 7 

Education 7 

Household repairs 6 

Go into businesa 4 

Clothes 2 

Miscolbneous 13 


The emphasis in moat studies in this field has been on buying rather 
than on doing and, as a result, distorted results have usually been ob¬ 
tained, The diatortLon is an overemphasis on the purchase of movable 
articles as compared with such items os education, traveling, going into 
business, building, redecorating. For most plans some capital and spend¬ 
ing is necessary, However, our testa proved that the emphasis on spend¬ 
ing tends to make people answer in the other extreme, which ia saving, 
holding on to their bonds. For these reasons surveys previously made 
have produced conflicting reports. Some have shown primarily the 
enormous purchases which people were going to make. Others have 
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indicated the large extent to which people were goijig to hold on to tlicir 
savings, 

Q. "Automobiles, wnshers, radios, houses, may he ftlsnul 20 per cent InRhor in 
price when they come back, In that cage would y<ni sd-ill hiiy theiu?" 

00% aiiswored "Yes.” 

32% auBwcwl "No.” 

B% were uncertain. 

Q. "(If answer was No in Q. 4) Why woulil you say you have iimtlo no pliiuaV'' 


Answera Total 

Uncertain as to end of wnr 10% 

Haven' b enough bonds or savings 0 

Haven't thought about it 3 

Will hold bonds until maturity d 

Don’t expect to need anything d 

No particular reason 3 

Do not use savingp to buy things 2 

Total 40% 


Q. "How much of the money you havo saved since the war do you oxpnot to iiso 
within B year or two after the war stops—nil of it, Iwo-lhirds of it, one-third of it, or 
none ot it?" 

Of all respondents, 21 per cent said tlioy rv'oro imcorUin, wiiilo 7 per cent said they 
had no savings. The renmiuder wero planning os follows: 

48% planned not to spend any Havings, 

24% planned to spend ono-third. 

15% planned to spend two-tUirds. 

18% planned to spend nil tlioir savings. 

Q. "Are you or the head of your family pretty sure of being al)lo to keep your 
present job after the war?" 

62% answered "Yes.” 

16% onswered "No.” 

16% had th^ own business or profession. 

7% were uncertain. 

Q. "(If answer was Yes) Do you believe that your pay cheek will bo as high, 
higher, or lower than now?" 

28% answered os high. 

15% answered lower. 

3% answered higlior. 

13% were uncertain. 

Q. "(If answer was No) If you think it likely that you will havo to change from 
your present job into a peace-time job, aro you fairly sure of getting such a job?" 

8% answered "Yea.” 

6% answered "No.” 

1% wero uncertain. 

Q. What are your diflimilUes in making a definite post-war plan for yonreclf or 
your family?" 
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No (liftinildcM in pJ.aHni«K ,'37% 

Uiir(‘rlfiin(i»'.'< dI cnjMliiiojw aHfr llns war .10 

1 iloii'l kiV)W vvliikO my jnb or iiir<iinn. will l»n 7 

1 iii\isL wail fi^r my litmlmlul or Aon lo come hnme 0 

llavo no •! 

iJcraiiHo of 3 

I'oii (iM lo pfnn; wifi retire good 3 

Mii?rt‘llint(ifiiiK r^oMKirt 10 

know; no answer 7 


(1. "If yon Itfnl yonr rln/ir/! (t»r; If you wore rlioo.siDs f»>r a linsiwuni or a l^rotlior) 
5v))at work or (iccyipiilioii would yoii I’hofwe, lifter the war, nf courrio?" 

Q, 1j, "Wlml lire you llllin^ unw?*' 


Aiifovers 

Doing Now 

Would Cliooao 

JoIj willi U. H, Ciovoninicnt 

7% 

21% 

Job ivitli City or iSlalo (roveniinciil 

6 

0 

Job wil|i lar^Q privnUi coin]>any 

25 

25 

Job willi Hinall privulc comiiimy 

17 

2a 

Own biiHiiicaa 

10 

11 

Profcfifwr, doRlor, lawytrj Icaclior 

7 

G 

In Army or Navy 

tl 

* 

li’armcr 

— 

1 

Miscolbncons, doJi'b know, no man 
♦Lcflfl tlinii .13 por cent 

11) 

0 


fJeceiVctl ifanuery 2 , 10 ///}. 



A Method for Investigating Color Preferences in Fashions 

B, Philip 
/i'orrfAawi Vnimnly 

Most investigations of fosMoa preferences have been baaed upon 
queationnairea, With the exception of Jacobson’s (1) work little dimen- 
sioival analysis under objective conditiona has been attempted in this 
field. To determine -whether the paucity of experimental work may be 
ascribftble, in part at least, to the difficulty of adapting modern tech¬ 
niques to this field, the well-’known psychophysical method of ranking 
was applied to the study of fashion preferences. Since the dimension 
selected was that of color, it was proposed incidentally, and by way of 
exemplifying the method, to determine whether men and women differ 
in their fashion preferences along that ffimeneion. As this was an ex¬ 
ploratory study only, few subjects wero used, and the statistical tech¬ 
niques were carried out by the methods of small sampling, 

One of the chief difficulties in an experimental study of fashion is the 
selection and presentation of the mateidal. Obviously each subject must 
have ample opportunity to observe the material undor the same standard 
conditions as every other subject. Were all observations made upon 
actual costumes, it is probable that other factors would tend to obscure 
the teal facta, and validity would be secured at the expenae of other 
qualities. Some procedure must bo found to condense the material, to 
shorten the observation time and to equate observational conditions for 
all subjects. 

Fortunately, instead of actual costumes, colored reproductions may 
be substituted with some confidence in the validity of the findings, 
People are accustomed to study fashions in this way, and often have 
recourse to pictures of garments to make their actual selections when 
purchasing clothes. One could proceed with much greeter confidence if 
published experimental studies gave actual validity findings. To our 
knowledge, none have appeared in the litemture. An unpublished study 
of the author, based on data from 19 men and 24 women in one group, 
and later, from 66 men and 106 women in another group, yielded average 
coTielations of 0.85 for the men and 0.95 for the women., between prefor- 
ences for actual material (Scotch plaid acarvea), and' colored pictures 
projected on a screen of these same scftTves, when both rank order and 
paired comparison methods were employed. Accordingly it was decided 
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to uee colored faHhion pUitcg in lieu of actual costumes. In order to 
make sure that these costumea wero in fashion, they were all selected 
from Vogue, for the current year, 1041, when this work was done.* 

The material finally Kolected consisted of live sets of colored fashion 
plates, Each set consiuted of 25 cards, all of the same size and showing 
one co.stuine, commonly known as an afternoon dre.ss; the costumes 
differed from card to card in some details, such as cut, ornamentation, 
etc. Within a set tlic costumes were of five different predominating 
colors, Black or Gray, Green, Blue, Ued and Brown, There were five 
cards of each color, which diffGi'Gd conaidemhly in hue, saturation and 
intensity; they were mostly monotone, although a few were striped or 
mottled. The sets diflercd among themselves in the height of the figure, 
which varied as follows; Set A, 11 inches; sets B and C, 9 inches; and 
sets D and E, 7 inches. The figures were cut out in silhouette and 
mounted individually on white cardboard, so as to leave an ample mar¬ 
gin, Thus tile size of the card in set A was 143^^ X 8 inches, and in sets 
D and E, 8^ X 5 inche.s. A small code letter at the top of each card 
was inserted to permit of ready identification. 

In the coding tlic seciuenco of colors was always the same, Black or 
Gray, Green, Blue, Reel and Brown. Thus the letters, o, /, k, p, and u 
always designated a Black or Gray card, and h, g, I, q, and v, a Green 
card, This coding system was intended to permit easy segregation of 
the colors in tabulation. However in the actual experiment the cards 
were always presented in random, order to the Ss, no one of whom no¬ 
ticed or understood the system used in coding. 

The procedure was siinplc. College students, 19 men and 9 women, 
were given a set of cards randomly arranged to lay out, in order of prefer¬ 
ence, on tt long table, They were provided with a set of typed instrue- 
tions as follows: 

Rank the following set of cards according to preference, placing the card you 
most prefer in'number one position, and placing the card you least prefer in 
the last (25th) position. Ratings are to be based upon general preference; 
all factors being taken into account. The question to be answered is simply, 
"Which outfit do you iirefer?*’ No ties are allowed, but the cards may be 
shifted in position a.s often as preferred. Work quickly, and do not delay too 
long over any choice, 

Tho .sets wore presented to tiro subjects in random order to equalize 
practice effects on the judgmentH of the various sots, Al! the rankings 
were entered on specially prepared tabulation slicet.s. One .set only was 
ranked by every subject at the experimental sessions, which occurred 
bi-weekly, The purpose of Bimcing the experimental sessions was to 

‘ A^cknowlctlgmcnt is licro made lo tho CJontlo Nost PabliaatiouB for supplying this 
matorial. 
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minimize the "halo effect" and fatigue or boredom. To determine test- 
retest reliabilities, some six weelia after the ranking o£ the (ifth set, the 
experiment was repeated for the women; the men were not available for 
this phase of the experimentation. By this procedure it was hoped that 
indications might he found whether or not there would bo any time trend 
in the fashion preferences, while the costumes wero still in fashion. 

Uesults 

The data were treated separately for men and for women. Linear 
scale values were computed by Guilford's method (2) ns.siiniing a com¬ 
posite atandai’d baaed on the group of stimuli witliin the set, as a whole. 
Scale values were used rather than mean rankings in order to evaluate 
the dispersions of the judgments of one set as compared with another, 
The scale values in each set were then totalled for each group of colors, 
to form a five by five tabic of colors va. seta, which was subjected to 
analysis of variance. As a check on the procedure, an analysis of vari¬ 
ance using total ratings rather than scale values yielded substantially the 
same findings. 

A point of some importance in this type of material is to determine 
how consistently the rankings are made by the individual and by the 
group. The degree to which the members of a group agree in their 
rankings may be inferred from the average intercorrelations of tho rank¬ 
ings on any one set of cards. These intorcorrelation values as determined 
by Kelly's formula, number 172, (3), and listed in Table 1, are positive 
and low, and average 0.220 for the women, and 0.134 for the men. 


Table 1 

Intercorrclationa of from Difforenl Sots of Canls 


Set 

Men 

Women 

First Uftting 

Women 

Second Rating 

A 


0.203 

0.163 

B 

0.136 

0.267 

0.175 

C 



0.327 

D 


0.171 

0.204 

E 

0.136 

0.13T 

0.243 

Mean 

0,134 

0.221 

0,220 


The reliability of the individual rankings for the women, from a retest 
after six weeks, based on the correlations of the first and the second 
rankings of a set by the same individual, is relatively high, since an 
average reliability of 0.593 is found from all five seta (Table 2). Since 
the complete experiment is based on tha rankings of five sets, were we 
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Table 2 

A-vernRO TosHletcst Helmhiliticfl for Women 
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Set 

Per Subject 

Per Card 

A 

0.fll4 

o.aol 

11 

0.008 

0.836 

C 

0.&r>3 

0.885 

t;) 

0.604 

0,700 

1C 

0.660 

0,813 

Moan 

0.603 

0,825 


to estimate the teat reliability by applying the Spearman-Brown for¬ 
mula, tlie correlation becomca 0.879. 

This is an average teat-rctest reliability pej' subject; but the average 
teat-reteat reliability may also be determined per card. It is obtained 
by correlating, by the rank-dilTcrcnco method, the total rating acores per 
card, yielded by tl\o first and second ratings. This procedure is, in efiect, 
a measure of the reliability of the group. These reliabilities are also 
presented in Tabic 2, from which it is seen tliat the average test-retest 
reliability per card is 0.825, whicli, when stepped up by the Spearman- 
Brown formula, becomes 0.959. 

Accordingly the test employed is of satisfactory reliability, yielding 
fairly consistent results for tl»c same individual, although individuals 
differ considerably amotig themselves in their preferences for any par¬ 
ticular costume. Furthermore, after a lapse of six weeks, the group 
judgments arc more consistent than the judgments of an individual. 
It is chiefly the reliability values found that give some confidence in the 
technique as liere outlined for the investigation of fa.shions. 

Since the experimental set-up was designed to investigate fashion 
preferences along a dimension of color by analysis of variance, it seemed 
of interest to do so, although it was recognized that the very small 
number of subjects would make any conclusions only very tentative and 
exploratory. The results are presented with this caution in mind, and 
are of course, only applicable to this group of subjects. 

Analysis of variance discloses that the color of the costume is a 
statistically significant factor in the fashion preference for the men, but 
not for the women, in this experiment. For signilicance at the 1% and 
C% level and with appropriate degrees of freedom, F = 4.77 and 3,01 
respectively; the F values obtained were 18.63 and 2,2G for men and 
women respectively. 

In order of preference the colors for the men were Blue, Black, Green, 
Red and Brown. The preferences for Blue were significantly greater at 



112 


B, M. Philip 


the 1% level than those foi Green, Red and Brown; for Black, signifi¬ 
cantly greater at the 1% level than those for Rod and Brown; and for 
Green, significantly greater than for Brown nt the 5% level As ^vas 
stated, color preferences for the women are not statistically significant, 
but the order of preference was Green, Bine, Red, Brown and Black, 
Mean linear scale values, assuming a composite standard, are given in 
Table 3. This table implies that Blue costumes were on the average 


Tabic 3 

Mean Linear Scale Values for Colors 



Black 

Greon 

Blue 

Bed 

Brown 

Mei\ 

■Women 

0.132 

-o.m 

■g 

0.250 

0.122 

-O.lOl 

-O.OGO 

-0.101 

-0.117 


assigned by the men a scale position 0.259 standard deviation times 
higher than the mean rankings of all the cards in a set. Here the poaitivo 
sign indicates a more favorable preference than tlie average. 

One naight also determine the tendency to make preferred judgments 
for the colors by noting the percentage of times the various colors were 
given scale values greater than the mean scale value in each sot. These 
percentages are given in. Table 4, which confirms, in general, the findings 
based upon mean scale values. 


Table 4 


Percentageg of frequency of Preferred Selectiona for the Various Colore 



Black 

Gcecn 

Blue 

Red 

Brown 

Men 

6B 

44 

76 

32 

32 

Women 

48 

68 

S6 

48 

30 


The men are more prone to group around the mean judgments of 
costumes that have no marked pontive or negative appeal; the women 
show greater dispersion of all judgments. Thus the relative proportions 
of judgments with scale values plus or minus 0.2 standard deviations 
from the mean, are for the men, and 35% for the women; and for 
scale values plus or minus 0.4 standard deviations from the menii, 81% 
for the men and for the women. 

Since such a high proportion of cards were grouped about the mean, 
the implication is that no clear-cut preferences exist for many of the 
costumes, and definite preferencea or rejections exist only for cards 
ranked in extreme positions, A listang of such preferences is given in 
Table 6, where the order of the color of the five most preferred costumes 
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Table 5 

Difltrii)ution of First Five and Last Five Choices per Set According to Color 



Hlftck 

Grncn 

Firat Choicca 
Blue Rod 

Drown 

Total 

Men 

8 

2 

11 

3 

1 

25 

Women, I 

3 

4 

11 

5 

2 

25 

Women, II 

1 

4 

11 4 

Itost Choices 

2 

25 


Black 

Green 

Blue 

Bod 

Drown 

Total 

Men 

2 

— 

1 

10 

12 

25 

Women, I 

7 

3 

3 

6 

e 

25 

Women, II 

7 

2 

a 

7 

fl 

25 


The diBlribution of the choices for the fiist and for the second ratings are listed 
along the rows Women I and Women II. 


per set corresponds quite well, for the men, but not for the women, with 
the linear scalo values. 

In tlie preferential positions the men in our experiment select Blue 
first and Black next, and in a decided manner they show least preferences 
for Brown and Red. The women also select Blue most frequently in the 
preferential positions, with tho other colom occurring in about equal 
frequency. They are prone to spread their least preferred judgments 
among all the colors, ivith an indication of lesser allotment in those 
positions to Green and Blue. Green is the favorite choice for the women 
when all tho cards arc considered, as may be seen from the listing of tho 
mean scale values, and from tho percentages of preferred selections, 
although it does not receive os many preferred choices as does Blue. 
A point of interest is the close agreement of the first and second ratings 
of the women, confirming the reliability values found. 

In summary we may state that this technique of investigating fash¬ 
ions is of adequate reliability. With the caution that this investigation 
hes been carried out with few subjects, and that factors other than color 
such as stylo and pattern were not controlled, there are indications that 
the men place considernblc emphasis on color in their rankings, Blue 
being tho favorite color and Black the next. The women base their 
selections on a veiy composite criterion, as was pointed out by Hurlock 
(4) and by Barr (6), but Blue is for them also a favorite color, ranking 
slightly after Green. However tlicir color preferences arc subordinate to 
other factors in costume selection, and in this investigation were not 
statistically reliable. It is of interest to note that the colors selected for 
this investigation are the live most preferred colors as found by Barr (5) 
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from her queatioiinairei and the order of preference is closoly the same in 
both investigations. 

Jiemwd Pibruary 2Ji, 19U. 
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Test Profiles as a Diagnostic Aid: The Minnesota 
Multlphasic Inventory 

Lt Col Hermann 0. Schmidt, AGD 

/.uiroai /IrMjy ^lir /■’iVW, Unroln, Nfhraska 

Tho pnrjxise of (his impor is to i)ro.scnt some findings in tlic use of the 
MinnoKota Mullipliasii; Pcrsoiialily Inventory in a clinical HiUiation. 

No aUenif)L will Ijo inndo here to dcscrilxj the devclopincnt of the 
lc9(, nor its aj)pli(!ul)iliLy us a clinical instniincnt flince those have been 
dcscrihed olKCwliere by its authors (1, 2, 3, 4, 5, G, 7), by Leveronz (8), 
and by Schichi, Halcer and Hathaway (9). 

The lest conHints of 530 items printed upon cards. The subject is 
asked to file these eunls into any one of three categories: True, False, 
Cannot *S'aj/. The test contuiii.s 12 scales: 3 validating scales, Question 
(cannot say), Lie and False; and ft rliagnostic categories: Hypoclioiidriasig 
(Hg), Dfipi'ession (D), Jlyslcria (Ily), Psychopathic Deviate (Pj), Masou- 
linity-Pomininity (M|), Paranoia (P*), Psj'chnsUienia (P,), Schizophrenia 
(S,) and llypomania (Mn). 

Tlicj data liavc. been gathered over a period of 9 montlis from cases 
studied in th<! Cion.Hultation Service of an Air Force replacement pool. 

Procedure 

Tho Multi))haHic Inventory was administored as prescribed in the 
manual of directions (0). It was given in go far us practicable as part of 
the routine on the ojrcning of a case. However^ the pressure of time and 
the lack of Hunicient teat sots precluded the possibility of testing all cases 
coming to the Service. 

All diugno.sc.s were made by qualified ncurop.sychiatrists, employing 
clussitications in common use in the Army, which in the main follow 
civilian irracticc, 

This was not a controlled experiment, in the sense that careful selec¬ 
tion of normal cuse.s was sought, or that purc-cuUure clinical groups were 
(or could be) oinj)loyc(I. Yet, there is reasonable cortainty that tiic test 
did not inducncc the clinical diagnosis. Throe of the foiu’ nouro- 
psychiati'isLs making diagnoses avoided the te.st, merely finding it inter¬ 
esting a 'pusliori that it .seemed to agree with the clinical findings. The 
fourth neurop.sycliiatri.st was (juite interested in the test, but with a view 
to assisting in this validity study, he Avas careful not to sec or to discuss 
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the test on a particular individual until after lie IwnI made hi.s clinical 
judgment.^ 

The Subjects 

The subjects were all Tvhite male enlisted members of the Army Air 
Forces. The clinical groups had been referred to the Con.siiltatJon Serv¬ 
ice because of difficulty in adjuating to Uvo Army BiUuvUon. T'Uo normal 
group was being re-evahiated, either becauae its rccord.s had bccoino lost, 
were incompletej or because there existed ovoragea in pui tioulttr occupa¬ 
tional specialties, making reclaasification ucces-sary. 

The deviate groups consisted of 121 subjects who fell into the diag¬ 
nostic categories: constitutional psychopathic state, inadciiuato person¬ 
ality; constitutional psychopathic state, sexual psychopatliy; psycho- 
neurosis, mild; psychoneurosis, severe; and psyehosie. There were sev¬ 
eral other groups, such as Organics, Simple Adult Maladjustment, Alco¬ 
holics, etc., but the cases were too few to have Btatigtical Bigaificance and 
are not inoluded here for that reason. Clinically, they were diffcrontinblo 
by profile. Table 1 gives descriptive data on the various groups os to 
number, age, intelligonco, years of schooling, montlis of sei-vico, marital 
atatua, rank, number of states represented, populatioii of tlio liome town, 
ond final disposition of the men who had been sUidicd. This latter 
column consists of a percentage computation into 5 categories: discharge 
from the military service; limited military duty; full field duty; hospi¬ 
talization (in moat cases general hospital is implied) and duty (?). The 
last named category comprised those men on whon\ the follow-up data 
were incomplete, the only thing being known was that tlioy were rotumod 
to duty, but whether on a full or limited duty Btatus could not be 
ascertained. 

The normal group consisted of 98 subjccta, who upon inquiry 
manifested no evidence of overt or covert personality disorder. Their 
civilian and Army histories were devoid of any indication of disturbance: 
some had been overseas, but in a quiet theater; some had “wnshed-out*' 
as aviation cadets, primarily For lack of psychomotor adaptability; but 
no trauma could be detected subjectively as attending either of these 
major sources of normal cases. 

In all groups, by inspection, the descriptive data (Table l) appealed 
to hove a noimal diatribution generally and to bo comparable. How- 

‘I Bhould like lo ftckaowlcdgo here roy mdobtodncBs to lab bt, Roliiud A. boalie, 
MC, for OAsistance and Inepiration oa a follow-workor anil in tho preparation of thin 
paper. 

•Hereafter tho eyrobols iV,, Cp, Cu, Pn» Pi and P,» will bo UEod to dwvgnato the 
normal group; OPI, iaodaquat©; CPI, Bexual pay^sliopathyj mild neurotica, Bovero neu¬ 
rotica and psychotic groups, respeoUvcly, 
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ever, the intellectual distribution ia skewed aomowliat Lo Dig left, iji that 
no Army General Classification Test group V^s were given the tost. Tliis 
■was because of the highly questionable ability of this low gT-ov\p to com¬ 
prehend the various test items. 

Kesults 

Figures 1-5 show graphicaHy the T-acorc profiles of tho t.'p, Cn, P^, 
P, and P,i, clinical groups together with the No group. 

Multlphasic Scales 
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Fia. 1. T-score profiles on the MuUipJiiwic Inventory for llie Normnl (Ao) imd 
eonstitulioiial psychopathic state, Tnadcqnntc pciHonnlity {Cp) groui)S, 
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Fiq, 2. T-Bcore profiles on the Multiphosio Inventory (or the Norma! (iV^,) ami 
constitutional psychopathic abate, sexunl psychopathy (C,i) groups. 




Fta. 4. T-acore profilca on tho Multiphaaic Inventory for the Normal (Na) and 
psyehonctJrosia, severe (P,) groups, 


Table 2 presents the means, sigmas and ranges of all groups; and 
Tiihlca 3, d, v5, (i and 7 give lire dilTcrencos, standard errors of difference 
and critical I’atio.H between the various groups (T-scorc values, uncor- 
reeted for small samples or beyond 1 decimal point). 

It is at once apparent from inspection of Figures 1-5 that the deviate 
groups present different and characteristic profiles from those made by 
the normal group. 
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The profile for the 'N, group is rcnsonably Hat and ftpproaolicfi closely 
the T-score mean level of 50. It is aomewhat lower RimoraUy than this 
mean range of 50 and lower than the normal curvo foinul l)y Leveronz (8). 
Within its own configuration the low point is reached on the doprossion 
scale; while the high point is for paranoia. 

The profiles for the deviate groups show obvious divergence from tlve 
normal profile. In all inatancea the curves are higher, being less m for 
the group and maximum for P,y. The dcprc-sHimi wmle appears m an 
index to the seriousness of the difficulty. It is higher than either hypo¬ 
chondriasis or bystoria in the P, and I\y groups, and lower for ail the 
others. In the case of the Cn group, the profde risas on the mnsculinity- 


l-lultiphttaic Scales 



Fig, 5. T*scotq profiles on the Mulliph&sio Invcmtory for the Normal (No) «nti 
psyohosis (Ptv) grou]]9. 


feraitiinity scale whereas in nil the other gi’oiips the curve is depressed 
at this point. By way of indicating charncteriising featurca of tlic various 
profiles, it may be noted that: 

(q) The Nt profile, although gcncrnlly a atraight line at T-scorc mean level, 
shows a low-poiut at depreasion and a high-pomt at paranoia; 

(5) The Cp curve has high points about 2 signin.s above moan level through 
the psychopathic deviate scale, drops to nearly normal at inasculinity-fcini- 
nmity^ rises to paranoia, drops agiun slightly on payohasthonia, riacs to achizo- 
phretua and falls off on hypomania; 

(d) The Cji profile is approximately a straight Hue, botweou 1 and 2 sigmas 
abovQ the mean level, with high-points on tho maficulinity-foiniiiinity iiud 
schizophrenia scales; 

Tlie Pm profile, at about 1 ugma above normal, dcaciiptively hIiows a 
high level at hypochondriasis-dapregsiQii-liystoria (depcesaiou lowest), <lvoppiug 
sharply on masculinity-femminity and riaisg sharply again to pHychaHbhcnia- 
schiaophrenia; 



Table 2 

T-Score Means, Standard Deviations and Ranges for the Normal Group (N,), Constitutional Psychopathic State, Inadequate Person¬ 
ality (Cy). CoTLstitutional Psychopatidc Stat«, Sesual Psychopathy (Cs), Psychoneuroais, Mild (?J, Psychoneurosis, 

Severe {?.}, and Psychotic (.PJ Groups, on the Separate Scales of the Minnesota Multiphasic Inventory_ 
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Table 6 


Comparison of psychoncurosis, mild {Pm), and the clinical groups of psychoneurosia, 
scvero (P.), and paychoaia (P,„) on the aaparate Multiphaaic luvcntoty acalcs 
Allowing difTcreiicG, standard DFror of diflercnce and critical ratio of T-scorea* 


p.l 

n, 20 

P. 

n, 04 

P.V 

n, 13 


Pm-P. 



P^-P., 


Dit. 


nysEdu. 

Dif. 

SBjif. 

DfSEdi,, 

? 

-.8 

1.3 

.6 

-1.1 

1.4 

.8 

L 

.2 

.0 

.2 

.8 

2.1 

,4 

F 

4.0 


2.0 

6.1 

3.4 

1,8 

II. 

11.4 

3.7 

3.1 

4.7 

5.5 

.9 

D 

20.1 

4.0 

4.1 

21.5 

8,7 

2.5 

H. 

12.7 

4.3 

3.0 

4.0 

6.8 

.6 

P.I 

13.1 

3.0 

3.0 

10.2 

7.1 

2.3 

Mf 



3.0 

8,6 

4,4 

1.9 

P. 



3.1 

20.2 

7.5 

2.7 

Pi 

12,4 

- 3.3 

3.8 

10.4 

6.2 

2,0 

S. 

12.0 

3.6 

3.6 

17.8 

6.0 

3.0 


0,1 

•2.8 

3.3 

11.1 

4,4 

2,5 


* DifTcrcnce ia hrfit of a pair from Bccond; hence, minus signs may occur. 


Table 7 


Comparison of psychoneurosia, severe (P,), and iJie clinical group of paychoaia (Pi,) on 
tho separate MuUiphnsie inventoty scales showng difference, standard 
error of differenco and critical ratio of T-scorea* 


P. 

n. 64 
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P.-P.„ 


Dif. 
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D/SE,ii,. 
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- .3 

,9 
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.6 

1,9 

,3 
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3.2 

.7 

II. 
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4.9 

1.2 
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1.4 

8.1 

,2 
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1.5 

P.I 

3.1 

0.8 

,5 

Mi 
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4.4 

.2 

P« 

0.9 

7.1 

1.4 

Pi 

-1.0 

4.6 

.2 

Ke 

•1.0 

5.5 

.9 

M. 

2.0 

4.0 

,5 


* Difference ia firgt of a pair from second; hcuce, minus signs may occur. 
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Tabic G 


Comptiriaon of pHychoneurosis, mild (I’m), ftud tlio clinical groups of psychoneuroaia, 
sevCTo (I*,), and paythoaia (P,„) on the Bcpnrato Multiphnaic Inventory scalca 
showing difference, aLandard error of dillcrcnco and critical ratio of T-scorea* 


Pm 

n,2(i 

P. 

n, O'l 

P.y 

n, 13 


P,n-P. 





Dif. 

KKiu. 

n/SF„,a. 

Dif. 

SEdif, 

D/SEa„. 

? 

~,8 

1.3 

.0 

-1.1 

1.4 

.8 

h 

.2 

,9 

.2 

.B 

2.1 

,4 

F 

■1,0 

2.0 

2.0 

C.l 

3.4 

1.8 

n. 

UA 

3.7 

3.1 

4.7 

5.5 

.0 

D 

20,1 

4.9 

4.1 

21.6 

8.7 

2,5 

Hy 

12.7 

4.3 

3.0 

4.0 

6.8 

.6 

Pd 

13.1 

3.0 

3.6 

16,2 

7.1 

2,3 

M( 

O.Q 

2.7 

3.0 

8.6 

4.4 

1,0 

P. 

10.3 

3.3 

3.1 

20.2 

7,6 

2.7 

Pi 

12,4 

3.3 

3.8 

10.4 

5.2 

2,0 

So 

12,0 

3.0 

3.0 

I7.fi 

O.D 

3.0 


0,1 

•2.8 

,3.3 

11.1 

4.4 

2,5 


* DilTcrcocc is firsb of a i}air from second; honco, minus signs may occur. 


'rable 7 


Comparison of psyclionourosU, severe (/’.), and tho clinical group of psychosis (P,„) on 
the separate Multipimsic Invoiktoi:/ scales showing difTeronce, standard 
error of (lifTcrencc and critical ratio of T-scores* 
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Difference is first of a pair from second; hence, miuua signs may occur. 
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(e) The P, curve ahowa a high plateau, 3 sigmaa above norn’ial at hypo- 

cliondrioais-depresBion-hysteria (depression slightly higher), drops at mnacii- 
hnity-femiumity, and rises again to Bchiftophrenia; 

(/) The ?,y profile shows a high peak on dcprcsaion at 3 sigmna above 
normal, a descending to masculinity-femininity to nearly normal, n sharp rise 
(2.5 aigmns) to paranoia, a alight drop at psyclmsthenin and a rise to nearly 
3 aigmas at achizophrenia. 

There is a decrease on all profiles on the hypomania soalo, 

Of the validating indicators, ?, L and F, the curve rises more sharply 
at F for the Psy group and has minimal accentuation for No. 

From examination of Table 3, where the No group is compared with 
the clinical groups, Cp, Ch, and P.u, it will be noted that in all 

but 6 instances a significant difference is apparent, the critical ratio being 
3.1 or higher—ranging from 3.1 for No-Cn on the Pd scale to 15,5 for 
No'P, on the Hy scale.® Of the 6 cases that diverge, 4 are in the No-Pm 
comparison on the psychopathic deviate, masculinity-femininity, para¬ 
noid and psychasthenic scales, wth critical ratios of 1.9, .7, 1.7 and .9 
respectively. The remaining 2 are on the masculinity-femininity scale 
for iV'o-Cp and No-Psy, with critical ratios of 2.8 and 2.6 veapcctivcly. 

In the matter of the validating items of 7, L and F scales, no signifi¬ 
cant diifei’ences appear on the 7 scale, although between No-Cn the 
critical ratio is 2.0, the No group having the higher ? score. On the L 
scale, the only difference possessing significance is that between No-Cn, 
where the critical ratio is 7.0, and where again the No group makes the 
higher score. The F scale shows significant differences in 3 of the com¬ 
parisons, and borderline signifi.cance in the remaining 2. In each in¬ 
stance the greater F score is made by the clinical group. The critical 
ratios in ascending order are respeolavely; No-Cn, 2.6; No-Cp, 3.1; Nd-P,y, 
3.6, and 6.7. 

Table 4 compares the Cp group with the other clinical groups. In 
only 2 instances here are there significant differences', the L scale has a 
critical ratio of 3.1 for €p-On, the Cp score being the higher; and the 
critical ratio for Cp-P^ on hypomania is 3.7, the Cp score being higher. 
Approaching significance is the critical ratio of 2,4 for Cp-Cn on the 
masculinity-femininity scale, the Ch group being the higher; Cp-P^o on 
the psychopathic deviate scale shows a critical ratio of 2.9, the Cp group 
being higher; and on the paranoid scale, Cp-P„„ tlie critical ratio is 2,9, 
Cp being the higher. 

Table 5 compares the Cu group with the clinical groups P„„ P, and 
In the validating scales, only the L score for Cn-P, sliow.s a differ¬ 
ence that is significant—the critical ratio is 3.8, with Cn being higher, 

Un this and succeeding discussion of sigiiificnnco, a critical ratio of 3.0 is tiikeu as 
the criterion for significance. 
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On the miisculiiiity-ferniiiinity and paranoia scales for Cn-Pm, and 
hypochondi’iasLs on (Jn-Pt the critical ratios arc respectively 3,6, 3.7 and 

3 . 1 , witli Cii liiglior in the first 2 instancGs, and the lower score in the 
latter, 'I'liose are the only significant dilTerences liere; but noteworthy 
are; critical mtios of 2.5 and 2.(5 for Cii-P„, on the schizophrenia and 
liypoinanic scales respectively, with C/i in each case the higher score; in 
tlie CirPi comi)arifi()n we find the respective critical ratios of 2,6 and 
2,2 on the seules fin (lejrression and masculinity-femininity, with the P* 
score higlier on the depression scale, and Cn higher on the masculinity- 
femininity scale; while for CmPty on the masculinity-femininity scale the 
critical ratio is 2,1, Cu being the higher score. 

Table 6 compare.s Llic Pm group witli the P, and Pay groups. In 
every instance on the main scales the higher score is made by the more 
disturbed group. Significant differences are seen in the P,„-Pj compari¬ 
son on all scales, the critical rntio.s being respectively 3,1, 4,1, 3.0, 3.6, 

3.1, 3.8, 3,0 and 3,3 for hypochondriasis, depicsaion, Iryateria, psycho¬ 
pathic deviate, masculinity-femininity, paranoia, psychasthenia, schizo¬ 
phrenia, and hypomunia. 

In tile comparison of Pm-P»ut only on the schizophrenia scale is a 
significant difference apparent, the critical ratio being 3.0, with P»v the 
higher score; but to be noted are the critical ratios of 2.5, 2,3, 2.7, 2,0 
and 2.5 on the scales for riepreasion, psychopathic deviate, paranoia, 
psychastlicnia and hypomanin respectively^—all scores being higher 
for P,y, 

Table 7 comjnwen the Pm-Pii, clinical groups, where no significant 
difFcrcncea can be observed. However, it is interesting to note that the 
trend is for the P, group to score higher on the scales for hypochondriasis, 
hysteria, masculinity-femininity, and p.sychasthenia; while the Pm group 
is the higher on the scales for depression, psychopathic deviate, paranoia, 
schizophrenia and hypomania. 

Siimmaiy 

As indicated earlier this is not an experiment in the usual laboratory 
sense; yet, every elToi't was made to maintain standard conditions for all 
groups and to prevent the intrii.sion of uncontrollable variables or artifact. 
The value of the MiilLiphasic Inventory as a predictive instrument and 
clinical tool depends upon its agreoinent with the clinical diagnoses. 
This is, of course, open to many pit-falls: the lack of a common psychi¬ 
atric language; the lack of clear-cut clinical criteria for identifying 
personality abnonnalities; the failure of an individual under study to 
present uncomplicated symptoms or to present crystallized behavior 
patterns; the lack of time for making a prolonged study of tire individual, 
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This explains to an extent the lack of greater definiteiiei5s in the diag¬ 
nostic groups employed here. No attempt has been made to define the 
groups beyond the major classifications. Since a clinical evaluation had 
to be made with the minimum expenditure of time consistent with good 
procedure, and since verification of the clinical diagnoses was generally 
unpracticable, greater precision here would not mean necessarily sub¬ 
stantiation in fact or in composite psychiatric or psychological opinion, 
Table 8 shows the recommendations made and the actual disposition on 
the 121 cases of this study. This is purely pi-agmatic. It must be borne 
in mind that final disposition of these caj^es rested ^yith a board of medical 
or line officers, few of whom had any genuine training in psychology or 
psychiatry. Yet, this subjective system was in agreement with the 
clinical psychological-psychiatric findings minimally at 62.8%; 41.3% 
were discharged; 17.4% were placed on a limited duty status, and 4.1% 
were sent to a general hospital for further observation and disposition. 
The follow-up data are deficiont in 29.8% of the cases studied. These 
men were returned to duty, but the percentages could not be ascertained 
as to which were for full duty and which for limited status. All of the 
psychiatrists making diagnoses were quaUlied neuropsyebiatrists. Two 
of them were fellows in the American Psychiatric A.ssociation. Three of 
these showed little or no interest in the Inventory (or any psychometrics 
beyond intelligence examinations); the fourth neuropsyohiatrist who had 
been on duty at the Consultation Service was definitely interested in the 
Inventory but purposely refrained from consulting it until after he had 
made a clinical evaluation. 

The several profiles of Figures 1-5, and Tables 3-7 indicate the agree¬ 
ment of the test with the clinical finding and point out its potentialities 
us an aid in differential diagnosis. Objective comparison of the diagnostic 
groups with a normal group has demonstrated statistically significant 
differentiations (Table 3). Even between the diagnostic groups, one 
finds distinctive and valid differences (Tables 4-6), typifying, or peculiar, 
to a general class of disorder or diagnostic group. Thus, the depression 
scale appears as an indicator of the seriousness of the disintegration; being 
lower than both hypochondriasis and hysteria in the psychopathic group 
and mild neurotics, and higher in the sevei'e neurotic and psychotic groups. 

The lack of statistical significance between the P, group and the P»i, 
group (Table 7) may be due to the small number of cases in the P,y 
group and its large standard deviations. Qualitatively, however, the 
profiles are different (Figs. 4 and 5). It is to be noted that the peaks 
for hypochondriasis, hysteria and psychasthenia are inoro pronounced 
than the other scales for the P, group; while, in the P,^, profile the peaks 
are for depression, paranoia and schizophrenia. 



Table 8 

Recommended. Action and Final Dispoation of the C^, Cb, P •> fl'Od P*v Groups 

Admit, to Returned to Duty; 
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The more probable explanation for the apparently eloso relationship 
between these groups (and aiao between Cp-Pi„ancl Cj;-P*y) is the gross¬ 
ness or ovei'allness of the classifications used here together with the 
generally non-crystallized reaction types. 

That the test is sensitive is further suggested in the group. The 
profile for this group is generally slightly below the T-seore ineiin of 50. 
but has a peak on the paranoia scale, In terms of its own ge.slalt, tliis 
would indicate a slight reduction in affect and a slight fixation of ideas. 
When one considers (cf. Table 1) that this group hn.s been in tlm Service 
somewhat longer than the clinical groups and that they have met with 
more success (attained higher ranks) than the other groups, one is in¬ 
trigued by the profile. It is essentially stable and Gs.scntially normal, 
Yetj it does differ from the expected T-scorc average and from the nonnnl 
profile as found by Leverenz (8). Could this bo the healthy, experienced 
soldier’s profile—phlegmatic and purposeful—or has there developed in 
this group a subtle personality alteration? 

Provocative, too, of further investigation in the No group arc the 
slightly elevated L and F scores. Has this gro\ip learned to jnit its best 
foot forward, but within affectively controlled limits, and at the same 
time has it become possessed with an idea, has it a singleness of purpo.se? 

Conclusion 

The purpose of this paper has been to present some findings on the 
use of the Minnesota Multiphasic Personality Inventory in a clinical 
situation. The cases were all male white enlisted men of tlio Air Force 
who had been studied at the Consultation Service of a personnel i-eplacc- 
ment pool. Of the cases seen, 98 were problems solely of administration 
and became the normal group, A total of 121 cases was Be.en because 
of maladjustment to the Army situation and these were subsequently 
diagnosed through standard practices by qualified neuropsychiatrists os 
either: constitutional psycliopathic state, inadequate personality; con¬ 
stitutional psychopathic state, sexual psychopathy; psychoneurosis, mild; 
psychoneuvosis, severe, or psychosis. Diagnoses were made independ¬ 
ently of the Inventory. The data thus gathered indicate that the Multi¬ 
phasic Inventory did in this empirical situation; 

1. Diatinguish graphically and with statiatical significance between 
normal soldiers and tliose diagnosed as constitutional p.sycliopaLlis; mild 
or severe neurosis; and psychosis. 

2. Differentiate with significance between major clinical groiip.s, 

3. Present qualitative differentials, or hints for clinical cpiery, in the 
more disintegrated or anomalous personality disorders. 

The data are in agreement with Leverenz' (8) observation that 
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ftlthougli tho clinical iinpimsion may not be corroborated alwaya by the 
scores, the clinician ia made aware of one or more personality abnormali¬ 
ties that rctiuire ovahuition. 

Received Oclober -2, lOU. 
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Use of the Minnesota Multiphasic Personality Inventory 
in Vocational Advisement * 

Lindsey R. Harmon and Daniel N. Wiener 
Veterans Admmwtrohon, MinntapoUi, Atvnncaolo 

At each of the 53 regional officea of the Veteiuna Administration the 
Adviaemcnti and Guidance Subdivision in the Vocational RGhabilitatiort 
and Education Division determines the need for ichabilitabion of disabled 
veterans and provides vocational counseling services leading to the selec¬ 
tion of appropriate employment objectives. The work of rehabilitation, 
including advisement and training, is conducted in accordance with 
instructions developed by the Central Office of the Vetevaua Admiiiiatra- 
tion in Washington, D. C,, to effectuate the provisions of Public Law 
No. 16, 78th Congress, as amended. Tiro vocational advisers in the 
Subdivision use army or navy records, case histories, interviews, and 
vocational information for their contributions to an appropriate voca¬ 
tional choice. In addition, the results of valid, reliable, and well- 
standardized testa play a considerable role in the advisoment, and arc 
administered as deemed necessary in tl\o advisement process. This ad¬ 
visement process has been described by Brophy and Long (1). 

At the Minneapolis facility, the Advisement and Guidance Subdivi¬ 
sion uses an extensive test battery which includes the Minnesota Multi- 
phasio Personality Inventory as a measure of personality. The need for 
a personality test in vocational advisement is recognized aa particularly 
acute since over half of the medical discharges from our armed forces 
have been for neuropsychiatric disorders. However, these digordera have 
been diagnosed only within the unique and tense framework of life in the 
armed forces and need to be related to the framework of civilian society. 
The Minnesota Multiphasic Personality Inventory was included in the 
personality measures because it appeared well standardized in terms of 
various clinical categories that could be related to vocational fields. 

After a preliminary Interview in which the provisions of the law and 
the regulations concerning vocational rehabilitation are explained to him, 
the veteran is assigned to an adviser who interviews him in order to 

* Special Qoknowleclgmenta are due to the Vetaraua Adminiatrcitioii which has fur¬ 
nished the data for thw article, and to the ofRoiela of the VetBrans Admluistiation whoao 
criticisms have been invaluable in its preparation. However, the authors assume sole 
reaponaibilily for Ibe opinions expressed. 
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complete a compreliciiaivc aurvey of hia background. On the basis of 
this iiitorview, the adviser indicates on a worksheet tho appropriate tests 
to be administered l^y the psychometriat. The Minnesota Multiphasic 
Poraonality Inventory ia usually indicated. The veteran then begins his 
testing. When it in done, he returns to his adviser who discuases employ¬ 
ment objectives with him on the basis of the records, tho previous inter¬ 
view, and the test result-s. 

The elements that comprise a counseling interview form a complicated 
pattern from which it is difficult to isolate for evaluation specific kinds 
of data. However, it ia apparent in many cases that a test result, a 
physical or mental disability, an aspiration, or a family ambition, indi¬ 
cates so important a characteristic of the individual’s behavior that it 
dominates the interview and the choice of the employment objective. 
Traits bearing this relation to the choice of an occupation are not infre¬ 
quently revealed by tho Minnesota Multiphasic Personality Invenfcoiy, 
even when no single scale ifi suflficiently elevated to indicate a clinical 
abnormality. Consideration of tho several scales of this test end their 
use in tho advisement of veterans in the Minneapolis office of the Vet¬ 
erans Administration during tho first several months of the rehabilitation 
program will servo to illustrate tlie usefulness of the Multiphasic Inven¬ 
tory ill this program. 

Tho summary of interpretations and uses of tho inventory in voca¬ 
tional counseling that follows is offered as tlic accumulated exporience 
of the Rehabilitation and Education Division of the Minneapolis office 
of the Veterans Administration. It ia the outgrowth of clinical experience 
rather than the statistical results of controlled experiments. It is hoped 
that experimental data may soon become available; pending such results, 
it is felt that these interpretations may servo as a useful guide in the 
employment of the tc.sfc. 


Use of the Scales 

Elevation on the scales of Hypochondriasis, Depression, and Hysteria 
has occurred more frequently than on the other scales of this test. Such 
elevations often indicate severe limitations on the kinds of work a man ia 
willing to undertake, most frequently eliminating dirty or heavy jobs. 
Also, it often indicates the desirability of a job at the lower end of the 
man’s ability level, where a minimum of stress will be cncoimteved; and 
tho avoidance of such high-pressure occupations as selling, investiga¬ 
tional, or promotional work. Similarly, when Paranoia and Schizo¬ 
phrenia scales are elevated, the relatively routine, well-regulated job is 
preferable to work requiring initiative, self-discipline and social contact, 
as these functions are particularly difficult for those with this withdrawn 
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type of personality. By contrast, elevation on the Psychopathic Deviate 
and Hypomanic scales incUcatea the type of personality most likely to 
adjust in jobs of a relatively undisciplined nature, where individual 
initiative and aggressiveness are at a premium, and which afford a maxi¬ 
mum of variety in work processes, locale, or associates. 

Elevation on the scales indicative of paranoia, psychasthenia and 
schizophrenia has been encountered less frequently tlmn on the other 
scales. When elevation on these three psychotic scales docs occur, a leas 
favorable prognosis of vocational success is indicated than would accom¬ 
pany elevation on the other six aqalea. A simplified program of training 
and employment appears advisable, with avoidance of occupations wlicre 
the skillful maintenance of social relations is an im])ovtant factor in 
success. Outstanding in such pei'sonalitics are the less desirable, less 
utilizable forms of adjustment than may be associated with elevations 
on the other scales. Hypochondriacs, depressives, and hysterics show 
symptoms with which associates may sympathize) in the psychopathic 
deviates and hypomaniacs the deviations may be self-compensating or 
even rewarding in certain oeoupations; the effeminate man may be the 
best-adjusted one in a number of professions. But the paranoid, schizo¬ 
phrenic and psychasthenic forms of adjustment have no apparent advan¬ 
tages or compensations to balance the disapproval and penalties tliat are 
placed upon them. These adjustment-patterns appear to be obstacles 
to success in practically all occupations and require the poorest prognosis 
of vocational Buccess. 

The Masculinity-Femininity score is often the moat difficult to inter¬ 
pret. It is sometimes depressed considevabty below obvious manifesta¬ 
tions of effeminate behavior and interesta, and it is often high without 
any overt manifestations or expressed interests to confirm it or give it 
significance in terms of vocational advisement. There may be a dichot¬ 
omy between feminine interests that can be acceptably and even svicccss- 
fully related to social relationships and occupational fields, and femininity 
or inversion of a socially unacceptable nature. In spite of these inter¬ 
pretative difficulties, this scale is frequently a useful guide to tlie coun¬ 
seling interview, indicating aesthetic propensities that can be related 
directly to a vocational field, or on effeminacy that contra-inclicatcs 
vocational fields where tough-mindedness is desirable. 

Test Battery Employcil 

In order to illustrate a few of the many ways in which the Multiphnsic 
Inventory has proved useful in vocational advisement, a brief description 
of the test battery of which the Multiphasic Inventory is a part w’ill be 
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presented, nnd ervse hiHtones will be examined. Each case is purposely 
Bclectccl to he typical of a group of eases; unique or spectacular illustra¬ 
tions have been avoided. AUhougli the Multiphosic results are described 
more fully here than is the information provided by the other tests, the 
latter must not l)c and have not been overlooked in counseling, 

The test battery that was lulininifllercd to the casc-s to be described 
wa.s os followH; Academic ability: Unit Scales of Aptitude, Vocabulary 
and Analogie.s, Otis Self-Administering Tests of Mental Ability, and the 
Ohio State University Psycimlogical Test, Form 21, for college ability. 
Clerical aptitvidc: Minnesota Vocational Teat for Clerical Workers. 
Mechanical ajjtiUule: Uevised Minnesota Paper Form Board Teat, 
Minnesota Spatial Itclation.H Teat. Manual dexterity: Minnesota Rate 
of Manipulation and O'Connor Test of Finger and Tweezer Dexterity, 
Vocational preferences: Kuder Preference Record, Strong Vocational 
Interest Blank for Men (Rev.). Personality: Minnesota Multiphasic 
Personality Inventory. All norms are in terms of general late adolescent 
or adult populations, except where otherwise specified. 

Scores, when given, arc standard scores, except for the Kuder Prefer¬ 
ence Record wliich is in j>crcentilc.s. The abbreviations used in reporting 
the Minne.sota Multiphasic Personality Inventory scores are: ?, Cannot 
Say; L, Lie; F; Valiflity; IIs, Ilypoclioadriasis; D, Depression; Hy, Hys¬ 
teria; Pd, Psychopathio-Deviatc; Mf, Masculinity, Femininity; Pa, Para¬ 
noia; Pt, Paychasthoiiia; Sc, Schizophreniu; Ma, Hypoinania, For de¬ 
tailed information on the Minnesota Multiphasic Personality Inventory 
see refcrencea in the bibliography. 

IJIiistrntivc Cases 

L. S. This high school graduate is 22 and single. Pie had been in 
the Navy for 4 months, 3 months in training to be a radio operator, and 
1 month in the hospital for serious delusions, depression, and anxiety. 
He was discharged for psychoncurosis rated 10% disabling. He applied 
for rehabilitation because his present work as a shipping cleric does not 
challenge him or offer a future, because he docs not have the "back¬ 
ground or amount of confidence” to fit him for other work, and because 
he cannot do work "calling for quick thinking or courage.” He primarily 
wants to train for a career in music, secondarily to manage an auto parts 
or some other busiiicas. Ho states, "I think my will can overcome the 
difficulties” which might interfere with success. 

On all tests but two, his academic, mechanical, clerical, and manual 
abilities and aptitudes are well above average. His highest points are 
the clerical testa, at the 99tb and 97th percentiles, His preferences are 
for literary and musical work, with the Clerical-Computational pattern 
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Becondary. The Multiphaaic Personality Inventory scores arc: 7 50, 

L 50, ¥ 80, Hs 65, D 70, Hy 67, Pd 86, ME 98, Pa 67, Ft 92, Sc 99, Ma 63. 

This man was completely ineffectual in the interview aitimtion. Ho 
looked down at the floor continuously, would respond only minimally and 
in a whisper, and was entirely amenable and suggestible to the adviser’s 
words. He used abstract terminoldgy, showed no aggres.sivcnes.s, and in 
general lacked orientation to the real world. The MuUiplm.slo Pcraoii- 
ality Inventory revealed enough extreme psychotic tendencies to warrant 
hospitalization at worst, and at beat, an employment objective of low 
enough level to place him under minimal streaa, yet Tes\icctablc and clean 
enough to avoid irritating him with ita physical demands. 

There was no evidence of musical ability except for expressed interest 
in Bong writing. He showed some appreciation of the difficiiltica involved 
in making a living in the field of music, and the desirability of being able 
to earn a living in a more stable field. Bookkeeping appeared to meet 
his needs and abilities best and was entered as his objective. As soon 
as possible, this man should be referred for psychiatric aid, The strong 
schizophrenic trend indicated by the Multiphasic Personality Inventoiy 
and the interview situation make continuing bucccsb in any employment 
objective doubtful, although he is doing excellent work in his training 
at present. 

J. M. This 22 year old veteran is ft high sclioo] graduate. He came 
in to apply for rehabilitation because he was not qualified for any ekilled 
job, and his present work, being unskilled, offered no future security. 
He had no expressed vocational preferences except for “desk work” which 
he “could do even if (he) didn't want to." Plis disability rendered hia 
left arm useless for moderate or great muscular exertion. 

Hia academic ability was above the average of the general population 
but below the average of college freshmen; his mechanical aptitude and 
manual dexterities were generally above average. His tested preferences 
were for persuasive, artistic, and literary work. The Minnesota Multi- 
phasic Inventory scores were: ? 50, L 50, F 66, Hs 65, D 53, Hy 60, Pd 50, 
Mf 69, Pa 50, Pt 66, Sc 67, Ma 68. 

The first interview had revealed no evidence of the deviate person¬ 
ality tendencies which were later indicated by the Multiphasic. After 
the Multiphasic results were available, however, ho was questioned more 
closely about his training, experience, and interests, in an attempt to 
discover the significance of the elevation in Mf. The Preference llecord 
was also available, indicating literary and artistic interests, which were 
associated with his Mf score. 

The second interview revealed not only some artistic interest, but 
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actual commercial art Kciiool training and extensive spare time work at 
cartooning. He was reluctant to mention this background, he said, be¬ 
cause he httd boon uuahlo to finish paying the art school. The adviser’s 
irapre.ssion was that he also wanted to avoid appearing effeminate or 
artistic. 

JIo Jatci’ lirought in Jiis work and it was judged favorably by a com¬ 
mercial artist. To objeotiveH suggested bcfoie he mentioned his art 
work, he had raised minor olijecUtms; later when an objective in art was 
suggested, he showed considerable relief. Ho was entered into training 
as a commercial artist where he is very happy and conscientious with hia 
work. His chnnce.s for aucceaa appear excellent. 

J.J. J, J. is a 29 year old man, with ninth grade education, He 
was a cook in the army and has a long work record that includes a variety 
of eemi-akillcd and unskilled jobs mainly on farms and in lumber campa. 
Ho fcols he needs schooling to qualify for light work which he has been 
told ia all he can handio now, and considers hia present job as a Railroad 
Ashman too insecure. His rated disability is valvular heart disease, 
80% disabling; lio is in the clo&s of heart disease ranked next to the com¬ 
pletely bedridden on a five point scale. 

Test results indicate a man of low academic ability, average clerical 
ability, and high mechanical aptitiido and manual dexterities. His tested 
profci'QncoB are for mechanical and artistic work, with the clerical field 
secondary. The Multiphasic Inventory scores were; ? 50, L 70, P 60, 
I-Ifl 53, D 70, Hy 76, IM 47, Mf 61, Pa 41, Pt 39, Sc 40, Ma 43. 

High point on the Multiphasic was Hysteria, with the Lie score and 
Depreasion also elevated. During the interview this veteran showed 
considerable concern about getting a "good deal," particularly looking 
for security. Ilia only objection to hia present work was that it was too 
insecure; actually it is heavy work that he should not be able to do if his 
disability were purely organic. This evidence together with the Multi¬ 
phasic Inventory evidence prompted a discussion with the cardiologist in 
which he stated that the disability was probably not as bad as rated on 
the basis of the evident organic symptoms. 

With this information, the advisement was subject to less limitation 
and it was possible to discuss with the veteran a fairly broad range of jobs 
in the mechanical field that involved up to a moderate amount of physical 
activity. The objective agreed upon was that of office macliino service¬ 
man involving a moderate amount of physical exertion which was not 
originally considered medically feasible. 

There was considerable evidence of emotional disturbance in this 
man’s frequent job changes, his indecision about what occupation he now 
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■wants to enter^ the incompELtibility of his pretjcut work and his disabilityj 
and his desire for education without specific reason. Tlui Ily, I) and L 
scores of the Multiphnaic Inventory were vnUialilc indicators of the form 
of his maladjustment. 

J. G. This 20 year old unmarried veteran left sclrool wliile in the 
tenth grade, joining the Navy as a fireman to begin wliat Im planned to 
be a Navy career. He was discharged with pulmonary iulxu-onlosis for 
which he receives maximum compensation. He l)cgnii lii.s advi-semenb 
VGiy certain that he wanted only to bo a bookkeeper, jintl .stated that lie 
saw no use in the testing and advisement /or liim a.s lit; kne^v what lie 
wanted and would fight until lie got it. 

Test results revealed above average academic ability, higli mechanical 
aptitude and somewhat above average manual dexterities. Ou the cleri¬ 
cal teats, he scored at the 9th percentile on Numbers and at the Slab 
percentile on Names. His interests were Computationnl-Clcricnl pri¬ 
marily, and Mechanical and Persuasive Bccoudavily. The Mulbiphasic 
scores were; ? 50j L 60, F 63, Hs 53, D 51, Ily 58, Pci '17, Mf 53, Pa 35, 
Pt 41, So 47, Ma 6S. 

Although the Ma score is not high in terms of al'jsolute norms, it is 
high relative to the individual pattern, and i.H indicative of Lho strongest 
characteristic in this man's behavior. His behavior iluring his hospitali¬ 
zation and since his discharge confirms tlio Ma [score, llo practically 
forced his way out of the hospHol, prematurely according to the doctors, 
and has insisted on immediate action Ihroughoul his dealings with the 
Veterans Administration, often to his disadvantage. 

This veteran did not show sufficient clerical aptitude to render book¬ 
keeping a desirable employment objective, and the personality inventory 
was higher on overproduebivity of thought and action than one would 
associate with successful bookkeepers; nor was there evidence from the 
background or interview, of basis for hia firm decision. The decisivenosa 
of his decision was a function of his personality. The interview con¬ 
firmed the Multiphasic Inventory, and it proved futilo to attempt to find 
a rational basis for hia preference, even though it was apparent that sales 
or mechanical work would be a more appropriate choice. Because of his 
insistence, he was permitted entrance into training as a bookkeeper. 
Prognosis for success in training was doubtful, and already reports on his 
progress indicate that he is "not putting forth hia best effort/’ which he 
attributes to the effect of the weather on hia lunga. 

E. M. This single, 28 year old Negro veteran suffered a foot infec¬ 
tion that required several months hoapitalization and left him with Umi- 
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tations of motion of liis foot and a need to avoid strenuous work. Shortly 
before discharge from the service he had been removed as platoon leader 
because of disobeying army regulations. 

An intelligent, pleasant man, he made an excellent first impression 
wliich WQ.S strengtljcncd hy the results of aptitude tests showing good 
abilitie.s for aeadeniie and mechanical work. He had previous college 
training in cliemi.stry and wished to he trained as a pharmacist. Hia 
mediocre grade.s in college he attributed to the fact that he was working 
several hours a day as [Ui electricians' helper in order to support himself 
at school. His vocational preferences were in the scientific, social service 
ond clerical fields, thus fully supporting his expressed choice. 

Because lie completed his advisement early in the history of the 
program, before tile administration of the Multiphasic Inventory had 
become routine, this test ivas not given to liim. He was inducted into 
training with no reservations except those arising from the fact that, aa 
a pharmacist, lie might have to spend too much time standing on hia 
injured foot, and the further limitation.s on placement possibilities be¬ 
cause of hia race. 

His Univorsity grades were poor on his first examinations. It seemed 
reasonable to attribute Ids difficulty to the long interruption in his college 
training. Wlicii they continued^ poor, a chock with his instructors re¬ 
vealed Hint his basic preparation in chcmistiy was poor and he did not 
seem to bo making any progress in learning. He was referred back to 
the Advi-^ement Subdivision with the notation that he apparently lacked 
the neccsmiy mental equipment to handle college work. Concurrently, 
he came to the attention of the counseling service of the University, 
where—'in addition to rc-tests of .scholastic aptitude and objective meas¬ 
ures of achievement in academic subjects—the Multiphasic Inventory 
was given. The results were: 7 50, L 50, F 58, Hs 53, D 56, Hy 49, 
Pd 98, Mf 63, Pa 70, Pt 70, Sc 74, Ma 70. 

A comparison of his report of his work and. actual grades showed 
numerous discrepancies, and his reasons for poor previous achievement 
did not hold up under investigation. The clinical history, on further 
checking, yielded other data that completed the picture of a conatitii- 
tional psychopathic deviate. 

The re-valuation of his vocational potentialities in the light of the 
above facts made it apparent that he would not be able to achieve up to 
hia mental ability because of his deficient self-discipline and direction. 
This hne of reasoning resulted in a down-grading of his objective from 
professional work to the skilled labor of electrical-appliance repairing, thus 
utilizing maximally his previous experience, taxing his abilities minimally, 
and affording a fairly wide variety of activities on the job. 
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R. S. A veteran of the South Pacific campaigiia, II. S. was dis¬ 
charged for mixed psychoneuroaia, rated as 60% disabling, and in addi¬ 
tion states he suffers from recurring malarial attacks. He is 24, and a 
high school graduate. His employmont experience consisted of truck 
driving and helping in his lathci-’B laundry. He fcelH that ho cannot 
return to any heavy work, is trained for nothing clae, and would like to 
become a Forest Ranger or a Certified Public Aeeovintant. 

His teats show about average academic ability and clerical aptitude, 
and an erratic pattern on mechanical aptitude and inarivial ilexterity 
tests, with scores more often above than below average. His tested 
preferences are for mechanical-scientifio work, with computational work 
secondary. The Multiphosic Inventory scores are: 7 60, L 60, F GO, 
Hs 97, D 87, Hy 78, Pd 65, Mf 59, Pa 56. Pb 79, Sc 7G, Ma 63. 

Although he indicated a preference for forestry work, when di.sciission 
centered on specific physical demands, he stated that lie could not do the 
manual work involved. His desire for it derived only from the possible 
college education involved. Neither did the idea of working alono in the 
forests appeal to him (note elevation on Pt). Mechanical work also, he 
was afraid, would be too trying for him physically. In spite of only 
average clerical aptitude, he would consider only bookkeeping as an 
alternative. This was entered as his objective on the. ba.sis of his ex¬ 
pressed interests and his personality, since it involved a minimum of 
physical and emotional stress for him and was not strongly contra¬ 
indicated. 

The primary adjustment in this ad-wsemonb had to be to the veteran's 
concern with his health, as the MulUphosIo Inventory indicated; D and 
Hy are concomitants of Ha, Within the one month period since he was 
assigned to training, he had to postpone entering the program for several 
days and was absent for about four days since beginning. Ho is taking 
medicine for his throat and has complained of trouble with hie eyes. 
The prognosis for his success is only fair, with the strong possibility that 
his extreme concern with his health will seriously interfere with hia train¬ 
ing and employment. 


Summary 

The Minnesota Multiphasic P^onality Inventory, as part of the test 
battery used in vocational diagnoaa of disabled veterans applying for 
rehabilitation, has proved to be an instrument of prime utility. It has 
served to delineate personality characteristics of crucial importauoo in 
the actual choice of a vocation, and has yielded, valuablejinformation to 
aid in prognosis of success in training. In some instances it has revealed 
personality characteristics that had not previously been recognized, and 
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in others offered quantitative confirmation of the clinical impressiona of 
a case history and intei'vio\v. 

It ia most useful as a part of a well-rounded advisement procedure 
including tests of vocational aptitudes, mental ability, and vocational 
intereata, and a thorough interview and case history. Improvement of 
Bpccific scales, particularly the teals of internal validity, which are a 
unique and valuable napect of this test, should further enhance its value, 
Additional clinical and experimental studies of the relation of tost acorea 
and patterns of scores to success in various vocations aecm likely to extend 
the uaefulneaa of this instrument in the vocational guidance clinic, but 
its practical value haa already been suflidently demonstrated to justify 
its employment on a basis of equality with tests of abilities and interests. 

Recmd June I 4 , J0/t4. 
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First Impressions of Classmates 

Wilhelmina E. Jacobson 
DrooUffn College 

That first impressions exert an important inflnonco in human lives 
hoa long been recognized. Meeting new people, visiting Hti'ange plflcos, 
facing unfamiliar situations, are part of the normal courHo of daily living, 
and in such circumstances first impressions are often the oulyguido to 
action. Wliere they are nob the sole determinants of notion, they un¬ 
questionably can contribute much towards specific belmvior at the time 
or at future times. When first impressions arc favorable, that is, when 
they elicit reactions anywhere from "love at first sight" to merely an 
unspecific sense of satisfaction, the natural result is acceptance or a desire 
for further acquaintance. Where the new situation takes the form of an 
interview for a job, for example, a favorable first impression on tlie 
employer would probably have the realistic result for the prospective 
employee of getting him the position. On the other hand, a negative 
first impression, leading to rejection and inclination to avoid further con¬ 
tact, would in the same situation mean failure. 

While from a practical point of view some general knowledge of what 
tends to "make a good imprea&on," or a poor one, is daily put to use in 
business and social relationships, yet very little is known specifically 
about first impregsiong. A study of their nature would therefore seem 
to be of considerable value, not only for its practical application, but for 
its value in helping to understand human behavior in general. 

The college campus at the opening of the school year presented wlmt 
appeared to be worth-while means of studying the nature of first im- 
pressiona. A freshman class hstd just arrived. The setting was new, and 
first impressions during the early weeks of adjustment were discoverable 
in the choice of friends and of clubs, and the ease or difficulty of orienta¬ 
tion to the college routine. Since social patterns are quickly sot in new 
situations, the impressions of these early weeks were to have their influ¬ 
ence, in all probability, on the entire Bchool cavcei' of these Htudenta. 

The writer had worked out, on a former occaaion, a method for study¬ 
ing first impressions as a means of facilitating the orientation of a fresh¬ 
man Clothing and iSelech'oa class. Her own first impressions of the 
students as a group had been varied. To her they seemed hopeful, 
expectant, bewildered. As new students, their clothes, hair dress, and 
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make-up were Koinewhat different from the campus mode. She believed 
tlmt tlic.so .studeJiis would bo able to derive most benefit from the course 
if they could see tliomsclvcs as ollicrs saw them and if they could learn 
to ''take it.” 

It seemed lliat ii tochniciuo used with success in one class might have 
value for the Personnel Department. As a result^ four weeks after the 
opening of the term the present study, with 258 students in the freshman 
College Zh‘oWc7n.s clas.s ns particiiTanls, was undertaken. 

I'he Problem 

The desire for approval, or to be accepted socially by one's associates, 
is a natural tendency of human beings. But what are the factors that 
cause one person to be accepted and another to be rejected? What 
must one be or do to be accepted by others? This study represents an 
attempt; to explore tliis problem by tlie following two main lines of 
investigation: 

I. Dolci'mining the extent of favoroblencss of the impressions made 
by freshman girls upon their classmates; II. Determining tho nature of 
first iinpro.ssiorifl. In this phfl.se of tlie study, two questions suggested 
themselves: A. What factors are involved? B. What influence do the 
observer’s own cliaractcrislias have on her observations? 

It was found that 22% of the 258 participants in the study had some 
degree of acquaintance.ship with others in the class, ranging from "slight” 
to "being a hdend.” It seemed desirable to retain tho data secured for 
this group and to see if they would reveal interesting comparisons be¬ 
tween first impressions and impressions influenced by acquaintance. 

The Group Studied. The subjects were women students in the College 
Problems class for freshmen at Ohio University. Of the 430 members 
of tho class, 401 served as both observers (those who gave their responses) 
and as subjects (those about whom the nssponses were made) in the 
experiment, Twenty-two members helped to conduct the experiment; 
seven were absent. The subjects were typical college freshmen, women 
who came from various sections of the United States, but mostly from 
towns and farms of tlje state of Ohio. 

Procedure. In a study of first impressions it is neccs.sary that the 
subjects have no acquaintance with one another, or that their acquaint¬ 
ance be so slight as to be negligible. The 430 students were divided into 
18 group.s of approximately 24 students each. Twenty-two of tho experi¬ 
menter’s college class in Clothing and Selection were put in one special 
group because they were to assist in the experiment. The group.s were 
made up by choosing eveiy seventeenth student from the alphabetically 
arranged roll. This was done in order to avoid acquaintanceships that 
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the girls might have formed by sitting next to one another in clasaea 
during the five weeks since the opening of the term. Each group met 
from 11;00 to 11:50 o’clock in separate classrooma in two of the college 
buildings. The Dean of Women, who taught the weekly College Prob¬ 
lems class as one unit, had told the girls in advance that they would meet 
that day in small groups. They were not informed na to the nature of 
this meeting, but were told to bring pencils as they would he asked to 
write. In this way the results obtained would be a cross section of 
student impressions on the campus on that particular day and at that 
hour. 

The 22 students' who had been selected to help with the experiment 
were trained for their jobs in their regular two-hour laboratory period 
from 8:00 to 10:00 of the same day. During this period they were told 
fox the first time the nature of the experiment to be conducted in the 
College Problems class that day, and were asked if they cared to assist, 
All volunteered. Each girl was assigned to a group; in five cases two 
students were assigned to a group.* 

Three graduate students who were student deans also assisted in the 
experiment, Each student dean was assigned to one floor where the 
groups were assembled, to aid the student assistants if they needed help 
and to give encouragement. Each student assistant had the following 
materials; 1. A list of the names and special numbers of the 24 girls in 
her group; 2. Twenty-four packs of 3 X 5 index cards, 24 in each pack; 
3, Typed directions (to be memorized); and 4. A watch with a second¬ 
hand, or a stop-watch. 

The assistants were told to call the roll as soon as the bell rang, and 
to distribute the cards. They then asked the class: “Would you be 
interested in knowing what 23 girls would be frank enough to say about 
you? If BO, each of you iu turn will volunteer to come to the front of 
the room, state your name, and remain there while your classmates write 
down their impressions of you on these index cards.” * 

For each subject in turn the girls at their seats took a separate card, 
wrote the subject's number in the upper right-hand corner, and one of 

* These students had been obsorvere and subjects in the First Impressions experi¬ 
ment the first week of the term. They had studied fclio remarks made about thorn and 
were working oa improvements, They hod voted 100% In favor of using the same 
technique in subsequent Clothing and Selection cloeaea. 

’ The nasigninent of these atudenta to take charge of particular groups woa baaed ou 
the experimenter's knowledge of the studeats gained from results on tUo Bernreuter 
"Personality Inventory," from results on tlte Ohio State University Psychological Teat, 
and from the students' work and cooperation in the Clothing and Selection class, 

’Jennings says that "in order to aeoute valid data, it is evident that sociometric 
teats must hold reality value for the subjects to which they are administered." Helen 
Hull Jennings, LeaeferaWp and isolation, p, 28, 1943. 
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the following phrases in the lower left-hand corner: (1) "Don’t know 
her/’ (2) "Know her slightly," (3) "Know her well/’ (4) “A friend." 
They were then given a minute and a half iii''whioh to list whatever re- 
marlca came to their minds about the subject as she stood before them 
flt the front of the room. When every girl in the group had acted as a 
subject, the [ussistant asked the ghls to write their own number in the 
lower right-hand corner of each card. The student assistants in the 
groups that finished before the end of the hour were told to instruct their 
girls to go back over their comments and to (1) place a plus (-h) sign in 
front of the comment if they meant it to be favorable, (2) place a minus 
( —) sign if unfavorable, (3) place a zero (0) if it was in-between. Then 
each girl put a rubber band around her set of cards, after including a 
separate card on top which contained her own name and number.^ All 
the cards were then collected. 


The Findings 

As each girl stood before her classmates during the experiment, she 
elicited several very definite responses from her observers in the form of 
short comments or remarks, for ©campk, "pretty blonde hair,” "good 
posture,” “very kind to others,” etc. At the beginning of the experiment 
the aim was to study first impressions only, but when it was found that 
a 22% acquaintanceship existed among the students, as noted before, it 
seemed worth while to study impressions more intensively. The re¬ 
sponses were therefore divided into four groups ("Don’t know her”; 
"Know her slightly”; "Know her well”; "A friend") according to the 
extent of ncquaintanceKship. tIic term “first impressions” was reserved 
for one group only, the "Don't know her” group. 

A total of 258 students (or 11 of the 17 groups)® completed the experi¬ 
ment and are included in the study findings. They served both as ob¬ 
servers and aa subjects. As observers they evaluated their responses as: 
-f- (favorable), 0 (in-between), and. — (unfavorable). The acquaintance¬ 
ship among these 258 students was 77% "Don’t know her," 16% “Know 
her slightly," 3% "Know her well,” and 3% “A friend.” 

The 258 individual observers gave a total of 19,352 responses, of 
which 12,149 were favorable, 1,903 were in-between, and 5,300 were un¬ 
favorable. This is an average (moan) of 47 favorable, 7 in-between, 
21 unfavorable, and a total (mean) of 75 response.g by each observer. 

* Tho girlfl were told they need not sign their names on the top card if they were 
not intcieatcd in knowing what their clnflamatea sEnd about them. Of tho 401 aubjeota, 
306 signed these cards. 

“ The obaorvora in six of the groups did not havo time to make the evaluations, and 
are therefore not included in this report. 
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Stated in percentages, the responses wore 03% fuvomblc, 10% in- 
between, and 27% unfavorable. 

The observers covered a wide range in ninnljci' of favorable and un¬ 
favorable responses. "Where one gave only 6 favoniblo rc.sponse.s, another 
gave QS many as 105, or, stated in percentages, one gave M% favorable 
responses, another 98%. The unfavorable respoimo.s raiigod from 0 to 
63 in number, or from 0% to 86%. One olisci-ver gave ns fnw as 38 
responses in all; another gave as many ns 123. 

These results show that the majority of the rospon.ses wore favorable, 
the unfavorable responses being less lliau half lUc favorable. The ob¬ 
servers tended to be definite in their respon.ses, tliat i.s, cither favorable 
or unfavorable rathei’ than in-between. 

To determine the nature of these students’ impre.s.sions of their class- 
mates, a detailed study was made of five of the eleven g\'oups“ by ana¬ 
lyzing 9,076 responses made by the IIC girls wlio comiirised the five 
groups. 

The study was begun by first claaaifying tlie individual rcmarica made 
by the observers in three cf the experimental groups being analyzed 
(these consisted of 3,335 individual responses given hy 72 observers). 
With the aid of two seniors (this provided the .student intcrprctatioii of 
student responses) the individual remarks were found to fall under 49 
sub-topics. Many of the risponses were found to have been repented 
several times in more or less the same Avay. Therefore, to facilitate 
handling, the entire 3,335 remn-rkg were grouped under 395 dilToreiit re¬ 
sponses under the 49 sub-topics.’ The 49 sub-topics then scoiucd to lend 
themselves to further classification under five general cnlegorios: (1) phys¬ 
ical characteristics; (2) intelligence; (3) clothing; (4) grooming; (5) psy¬ 
chological factors, 

The next step was to obtain the consensus of expert opinion on the 
classifications. Tour qualified membci's of the faculty made this evalua¬ 
tion: the Dean of Women, the head of the Department of Home Eco¬ 
nomics, the head of the Department of Psychology, and a member of 
the Department of Home Economics with a background in Psychology. 
They determined whether the 395 different responses belonged under the 
categories and sub-topica in wliich they had been placed, or elsewhere. 

", A compaiieon of tho scleated five groupa with the 11 groups with lespcob to mean 
Psychological Test Score, Bell AdjuBbrnent Inventory Scores, Degree of Actniaintnnce, 
and number and % of responses per observer, ahows that they npproxiiinilcd tlio fiiitl- 
inga for tho eleven groups qs a whole, thoreforo making tho study of additioiud groups 
unnecessary lor the purpose of this experiment, 

^ Many of the sub-topics used by the expcrimctitcr and tho two Boniora wore found 
to have the same meaning as those used by Gordon W. Allport, In these coses, thore¬ 
foro, Allport’a torromology was accepted, Gordon W. Allport, Perscnalitu, p. 403, 
1037. 
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Following is the final clnssifieation of categories and sub-topics deter¬ 
mined on the basis of those judgments, with a typical response for each 
sub-topic: 

ClasHification of ImpreaaionR, with IVpical Responses 

1. PhyHicfvl Characteristics 


(A) PhysKiuc 

1, Hair 

2. Kyefi 

a. Eyebrows 
4. Mouth 
fi. Noso 
(). Teeth 

7. Complexion 

8. Dimples 

9. Eiguro 

10. Height 

11. Weight 

12. Posture 

13. Carriage 

14. General charncfccristica 
Ifi, MflRCUlinity-femininity 

(B) Ifl. Health 

(C) 17, Vitality 

(D) 18. Voice 

II. Intelligence 

19. Abstract 

20. Practical 

III. Clothing 

22. Harmony of parts of costume 

23. Harmony of colors 

24. Suitability of clothes to 
person 

25. Suitability to occasion 

26. Manifestations of taste in 
dress 

27. Fit of dress 

28. Remarks about clothing 

29. Principles of art involved 

IV. Grooming 

30. General remarks 

31. Make-up 

32. Hair dress 

33. Shoes 

34. Nails 

35. Cleanliness 
3B. Laundering 


-h “Pretty blonde hair" 

4“ "Large eyes" 

0 “Eyebrows could be thinned'' 

— “Not very attractive mouth" 
+ “Cute nose" 

-j- “White teeth" 

— “Too pale" 

“Beautiful dimples" 

-}- “Good figure" 

— “Too tall for a girl" 

0 “Should lose some weight" 
“Good posture" 

“Carries herself nicely" 

-j- “Very attractive face" 

— “Boyish in appearance" 

— “Unhealthy looking" 

— “Looks worn out” 

-h “Nice voice" 


+ “Looks brilliant" 
-j- “Looks effmient" 


— “Should not wear heels with 

ankle sox" 

— "Too many different colors" 

+ “Wears becoming clothes" 

-j- “Wearing suitable school 
clothes” 

-j- “Good taste in dress" 

— “Skirt doesn't fit properly" 

-h "Pretty sweater" 

— “Bow is too largo for its posi¬ 

tion" 

-h “Dresses neatly” 

— “Needs more make-up” 

— “Hair could be fixed differ¬ 

ently" 

— “Shoes could be cleaned" 

— “Too dark a shade of nail- 

polish" 

-p “She looks clean" 

— “Belt is a little soiled" 



^iUielmina E. Jacobson 


148 


V. Peychologiofll ChftraoteriBtics 

21. Manifestations of emotions 

37. Ascendance—sub-missive 

38. Expansion—reclusion 
39- Persistence—vaciHation^ 

40, Extrovcraion—^introversion 


41. Solf'objeotification—self- 
deception 

42. Self-assurance— self-distruBt 

43. GregnTiouaness-T^tJ^itMineBa 

44. Altruism (aociaUzatioa)— 
self-seeking (unsocinlized) 

45. Social intelligence (tact)—low 
sociol intelligence (tactless) 

46. Directed toward values 

47. Radicalism—conservatism 

48. Observers’ likes and dislikes 
of subject 

49. General reaponBes 


— ‘‘Afraid to smile in public” 

-b “Dominant nt times” 

0 “Quiet" 

— “A bit flighty” 

0 “Acts as if alio would be nice 
after you know her but seems 
to liavo n wall you would 
Imvo to break through first” 

-h “Imagine she would bo sincere” 
4 - “Scoms rather euro of herself'' 
+ “Vftry atK.ia.Wft ur {riftudiy” 

+ “Very kind to others” 

— “Not always tactful” 

-f- '‘Seems serious about college” 
-j- ‘'Very conservative type” 


— “Don't think I'd like her” 
"i* "A groat deal of charm” 


A tabulation was then made of the 9,076 respouaea of'tho 116 ob- 
seryeiB. These were classified according to categories, sub-topica, ob- 
eervers, favorablenesg, and extent of acquaintanceship. It was thus 
possible to study impressions from many poznte of view. 


What Eactors are Involved in the Observers' Responses? 

The groups or sub-topics under which the reaponaea were classified 
show wide variation in frequency of - mention, and also in extent of 
favorableness. Six of the 49 sub-topica constitute over 50% of the re¬ 
sponses; Grooming—general remarks; grooming—hair dress; posture; 
emotions; self-assurance—self-distrust; altruism—self-aceking. Eighteen 
sub-topics include 93% of the re^onsea (na indicated in Table 1). These 
18 sub-topics also include 1% or over of the total of 9,076 responses, 
The remaining 31 sub-topics consist of less than 1% each. 

The Bub-topic of greatest frequency concerned general remarks on 
grooming, pertaining mainly to neatness. These general remarks and 
remarks on hair dress (second in frequency) cover 23,7% of all responses; 
when posture (which is third) is added, they make up 33.9%, or one-third 
of all the responses. Add the next three sub-topics—emotion, self- 
assurance—self-distrust, and altruism—aelf-seeklng, and over 50% of all 
the responses are covered. 

The five sub-topics which rank highest in favorable rcaponses arc: 
1, hair; 2, eyes; 3, altruism—self-seeking; 4, general physical remarks; 
and 5, taste in dress. For each one of the sub-topics the favorable 
responses were over 86%. 
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Table 1 


Number and PcrcenUifio Distribution of tho 18 Highest Rooking Sub-ropics 


lUink 

No. 

Sub-topics 

Responses 

Evaluation of 
Responseg in 
Per Cent 

No. 

%of 

(0,076) 

Item 

+ 

0 

- 

1 

30 

GroomliiR—Ronornl roinarkfl 

1,224 

13.6 

82 

4 

14 

2.13 

32 

Grooming—liair dreas 

029 

10.2 

47 

10 

43 

2.5 

12 

Posture 

020 

10,2 

51 

14 

36 

4 

21 

Emotione 

797 

8.8 

04 

0 

27 

6 

42 

Sclt-aasurance—eclf-distruBt 

682 

0.4 

13 

27 

60 

0 

44 

Altruism—self-seeking 

520 

6.8 

89 

3 

8 

7 

43 

Gregariousness—solitarinces 

609 

5,0 

81 

6 

13 

8 

20 

Taste in drees 

432 

4,8 

87 

6 

7 

g 

14 

Gencrnl clmmctcristica—physical 

413 

4.6 

88 

7 

5 

10 

31 

Grooming—moke-up 

378 

4.2 

17 

12 

71 

11 

26 

Clotliing—suitability to occasion 

240 

2.6 

72 

3 

26 

12 

23 

Clotbing—harmony of color 

236 

2.G 

67 

4 

39 

13 

1 

Physical charactcristicB^hair 

230 

2.6 

97 

1 

2 

14 

24 

Suitability of clothes topcison 

104 

2.1 

41 

5 

64 

16 

7 

Physical—complexion 

182 

2.0 

74 

10 

16 

16 

2 

Eyes 

145 

i.e 

96 

0 

6 

17 

22 

Clothing—harmony of parts 

139 

1.6 

31 

6 

64 

18 

28 

Remarks about clothing 

115 

1.3 

83 

8 

9 



Total 8,100 

90.3 





When an analysis is made of the unfavorable remarks, it: is obvious 
that four sub-topics—make-up, harmony of parts of costume, self- 
assurance—self-distrust, suitability of clothes to person—rank highest in 
that order, and all are over 50% of the responses in each sub-topic. 

The procedure in fchia experiincait waa sucli as to produce (reasonable 
expectancy) self-consciousness in the individual subjects, yet 27% of 
the self-assurance—self-distrust responses were neither favorable nor un¬ 
favorable, and these ranked highest of the in-between responses. 

Relationship between Categories and Acquaintanceship Groupa 

A study of Table 2 makes possible the following generalizations re¬ 
garding relationships between categories and acquaintanceship groupa. 

1. Psychological responses constitute the greatest proportion of the 
total responses, 30% of the total number. They are also most frequent 
in all acquaintance groups, except the “Don’t know her” group, where 
responseg concerning grooming are slightly in the lead. This tends to 
indicate that grooming is most obvious to the stranger, but as the girls 
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Table 2 


Percentage Dietribntion of Responaca (110 Obaorvers) 


Category 

Don't 

Know 

Her 

Know 

Her 

Slightly 

Know 

Her 

Well 

A 

Frioiicl 

AU 

Groups 

Physical 

24,0 

24.2 

27.0 

24.B 

24.2 

Intelligence 

1.1 

.8 

.6 

.0 

1,1 

Clolting 

16.8 

14.8 

12.2 

13.3 

16.4 

Grooming 

30.3 

27.2 

22.7 

22.0 

20.3 

Psychological 

28.8 

33.0 

37.7 

38.5 

30,2 


Total 100,0 

100.0 

100.1 

100.1 

100,2 


N » 0,899 

1,558 

393 

220 

0,070 


become bettei’ acquainted, responses of a psychological nature iucrease, 
this increELse, in this study, being 9.7%. They seem to indicate that 
strangers tend to comment about grooming, while acquaintances tend to 
comment concerning traits, attitudes, and temperament. 

2. Grooming responses take second place and show a decrease as 
acquaintanceship increases, this decrease being 7.7%, namely, from 30.3 
to 22.6%, 

3. The responses of a physical nature take third place in “All Groups” 
and in the "Don’t know her" and “Know her slightly" groups, and 
second place in the last two groups. The better acquainted the girls 
were, the more they tended to comment about physical characteristics 
and less about clothing and grooming. Responses of a physical nature 
also remain almost constant for each acquaintance group, namely, 
about 24%. 

4. Clothing^ takes fourth place in all acquaintance groups. The 
clothes the students wore elicited comment only half as frequently as 
grooming or psychological characteristics. Clothing responses remain 
nearly the same for each group, ranging from 12 to 15%. 

Relationships between categories and acquaintanceship groups, as 
influenced by favorableneas, are indicated in Table 3. Certain inferences 
can be drawn from the percentages given. 

1. A large majority of the 9,076 responses indicate favorable impres- 
Bions—62% favorable to 28% unfavorable. The proportion is five favor¬ 
able responses to three unfavorable and in-between combined, This 
majority of favorable responses is true for the total responses in all five 
categories. This finding con*oboratea Jennings’ statement that "positive 
expression for participating with otliei'S was practically twice as great as 
the expression of rejection."® 

® Helen Hall Jennings, Lead&^vp and isolation, p. 60, 1943. 
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Table 3 


Per Cent of Favorable and Unfavorable Responaes ClesaiBed According to 
Acquaintoncealiip Group and Category (116 Observers) 


Category 


Don't 

Know 

Her 

Know 

Her 

Slightly 

Know 

Her 

Well 

A 

Friend 

Total 

Pliysical 

+ 

07,6 

70.0 

84,0 

91.1 

69,3 


0 

9.9 

8.0 

3.8 

1.8 

9.0 


- 

22.7 

22.0 

12.3 

7.1 

21.7 


Total 

100.1 

100.0 

100.1 

100.0 

100.0 


N = 1,653 

377 

108 

66 

2,192 

Intclligcnco 

+ 

74.4 

60.2 

100,0 

100.0 

74.7 


0 

14.1 

23.1 

00.0 

00.0 

14.7 


- 

11.6 

7.7 

00.0 

00.0 

1C.6 


Total 

100.0 

100.0 

100.0 

100.0 

99.9 


N = 

78 

13 

2 

2 

95 

Clothing 

-h 

62.3 

00.7 

77.1 

86.7 

64.0 


0 

6.6 

6.2 

00.0 

3.3 

6.2 


- 

32,2 

25.1 

22.9 

10.0 

30.2 


Total 

100.0 

L0Q.0 

100.0 

100.0 

100.0 


N = 1,088 

231 

48 

30 

1,397 

Grooming 

+ 

60.6 

64.6 

74.2 

70.6 

68.7 


0 

7.0 

7.1 

1.1 

2.0 

7.2 


— 

36.0 

28.4 

24.7 

21.6 

34.0 


Total 

100.0 

100.0 

100.0 

100.0 

99.0 

Psychological 

+ 

60.0 

66.3 

68.2 

87.4 

69.7 


0 

13.3 

11.7 

10.1 

6.8 

12,0 


— 

30.7 

22.0 

21,6 

6.6 

27.8 


Total 

100,0 

100.0 

99.9 

100.1 

100,1 


N « : 

1,987 

614 

148 

87 

2,730 

Total 

+ 

60.1 

67.3 

75.1 

85.8 

62,6 


0 

0.5 

8.7 

6,1 

3,5 

9.0 


— 

30.4 

24.1 

19.9 

10.6 

2B.3 


Total 

100,0 

ido.i 

100.1 

99.9 

99,9 


N = 1 

3,890 

1,558 

303 

226 

9,076 


2. Responses of a physical nature show a greater per cent of favorable 
responses (omitting intelligence) than clothing, psychological or groom¬ 
ing, as shown in the "Totals" column of Table 3, the percentage being 69,3. 

The fact that comments regarding physical features were usually 
favorable became quite noticeable while reading the 19,352 responses. 
It is interesting to note that unattractive features of the face were rarely 
commented on. Most of the 21.7% of unfavorable comments in the 
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physical group concerned posture (42.4%), a factor which usually can 
be corrected, 

3. Clothing and grooming show the greatest per cent of unfavorable 
responses (30 and 34 respectively). Theae features can be changed; 
therefore the girls may have felt they could be critical. 

4. The in-between responses show the greatest per cent of responses 
in the psychological category and tho next greatest in tho physical. 
Again, the general tendency of the observer is to refrain from rospondiug, 
or to give an indifferent leaponae, if the feaUire ia one that cannot be 
easily changed. 

5. An increase in the extent of acquaintanceship is accompanied by 
an increase in favorable impressiona, os aliown in the per cent of total 
responses, where the percentage increase is from 00.1 for "Don’t know 
her” to 67-3 for "Know her slightly," 76.1 for "Know her well," and 85,8 
for "Afriend.” This increase ia truefor each of the individual groups,— 
physical, clothing, grooming, and psychological. 

Q. The per cent of increase in favorable comments with ncquaintance- 
ahip (that ia, from "Don't know her" to "A friend") was aharpest in the 
psychological category,—31.4%. As the students became better ac¬ 
quainted they showed a greater tendency to remark favorably about 
psychological factors. Qrooming ahowe the least gain, 20%. 

"What Influence do the Observer’s Own Characteristics Have on 
Her Observations? 

As noted before, the personality adjustment of each student woa 
obtained from results on the Bell "Tho Adjustment Inventory” and her 
intelligence score on the Ohio State University Psychological Test. It 
seemed that certain inferences could bo drawn from tho observer’s chav- 
Bcteristics, as revealed by these tests, and her observations. 

1. Correlations between the observers’ scores on the separate sections 
of the Bell-Adjustment Inventory and the favorable responses made by 
the observers show coefficients less than .089, except in the case of Bell 
(Home) and favorable impressions where r = .28, a value significant at 
the .01 level. This seems to indicate a slight tendency for students with 
satisfactory home life to give favorable responses about their fellow- 
students. 

2. The observer's personality adjustment (Bell-Total) and the kind 
of responses the observer makes—phyaical, clothing, grooming, or psy¬ 
chological—seem to be independent of each other. Each of the four 
correlations has a numerical value leas than .13, and these are not sig¬ 
nificant at the ,01 level. 
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What influence does the observer’s intelligence have on the kind of 
response she makes? 

1, The observer's intelligence (Ohio State University Psychological 
Test) and the favorable responses she makes seem to be independent of 
each other (r = - .10). The more intelligent observer, on the whole, is 
about as favorable in her responses as the less intelligent observer.® 

2, The observer's intelligence and the kind of response she makes— 
physical, clothing, grooming, or paychdogical—seem to be independent 
of each other, except in the case of clothing where r = ,34, being signifi¬ 
cant at the .01 level. This seems to indicate that there is a tendency for 
students who arc above average in intelligence to make more than an 
average number of comments about clothing. College women on the 
freshman level are clothea-conacioua. It is possible that the more intelli¬ 
gent girl may be more observant, and also that she may know more about 
the latest mode, or what is correct in costume, than the less intelligent 
girl. 

3, The more intelligent observer tends to give a gi'eater variety of 
responses than the leas intelligent: r = .32, this being significant at the 
.01 level. This may indicate that the )c^ intelligent student tends to 
make the same type of comment in giving her impressions, limiting her 
statements to a few sub-topics. 

Certain other factors seemed to influence the observer’s impressions. 

1. Obaevvers differ in their taste in dress. Oive remarked about a. 
subject: "She dresaoa nicely" (-f-). Another stated of the same subject: 
"Anklets don’t match dress" (—). 

2. Observers differ in their standards of grooming. One remarked: 
"Well groomed" (4-), while another’s comment about the some subject 
was: "Could be more neatly dressed" (—). 

3. Observers differ in their interpretation of traits and attitudes. 
One observer remarked: "Looks friendly" (4), while another said of the 
same subject: "Looks like she might be hard to get along with" ( —). 

4. Observers differ in their conception of "Good looks." One ob¬ 
server remarked about a subject, "Not attractive" (“), while another 
remarked: "She has simple beauty" (4)i while a third described her as 
"Fairly attractive” (0). 

Summary 

This study of impres.sionB of one's classmates shows that the freshman 
girls included in the study were favorable in their evaluations of their 

’ Duck found a low correlation between thinking and behavior. Buck, N. M,, and 
Ojemann, R. H., Relation between ability in aciontifio thinking and behavior in situa¬ 
tions involving choice. J. exper. Educ., 1942, 11, 217. 
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classmates rather than unfavorable or neutral, Tlicrc -wero blirco /nvor- 
able I'esponsea for every two unfavorable mid iii-lietwcen combined. 
This would indicate that the "frankneas of modern youtii" in of a kindly 
nature ratlier tlmn the opposite. 

The 9|07G responses made by the 116 observers were fovnul to fit in 
the five selected categovies: (1) physical characteristics; (2) intelligence; 
(3) clothing; (4) grooming; (5) psychological cluivtLGteristic.s, such ns 
traits, attitudes, and temperament. They also could bo brf>kcii down 
into the 49 concrete factors of varying importnnee in the judgincnb of 
toe freshman girls. However, over 50% of the iinprcs.sions were cov' 
ered by 6 sub-topics and 90% by 18 sub-topics (see Table 1). 

Of bhe five categories, responses of a psychological nature wore most 
frequent, with grooming second, physical clmvactcriatics third, clothing 
fourth, and intelligence fifth. Students who were not acquainted tended 
to remark on grooming, but es acquaintance increased they tended to 
comment increasingly on psychological characteristics. Degree of ac* 
quaintanceahip has little effect on the per cent of re.spon.ses of a pliysical 
or clothing nature, 

Characteristica of a physical nature, especially the face and features, 
were commented on favorably more frequently than otlicr factors. On 
the whole, the students were very considerate when nothing could bo 
done to correct a defect. But they wcic equally critical when grooming 
or clothing was concerned. 

There seemed to be no significant correlation between a studcntks own 
personality adjustment and her incUnation to give favorable or unfavor¬ 
able responses, or to comment about physical, grooming, clotliing, or 
psychological factors. Where the girls'had favorable home conditions, 
however, they tefided to respond favorably. 

Nor was there significant correlation between a student's intelligence 
and her favorable or unfavorable replies or her responses regarding 
pliysical, grooming, clothing, or psychological characteristica. They 
seem to be independent of each other, except in the ca.sc of clothing, 
where there appears to be a slight tendency for the more intelligent girl 
to comment about clothes. 

The responses showed that students vary greatly in their taste in 
dress, their standards of grooming, in their interpretation of trails and 
attitudes, and in their criteria for "good looks." 

Tlie responses of a physical and clothing nature are about constant 
for the four acquaintance gi’oups. But re.‘iponses regarding grooming 
decrease as acquaintanceship increases, while psychological responses 
increase with acquaintanceship. 

Within the limits and limitations of this study, the results may sug- 
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gest the pattorn of responsca nccesaary to get along with other people. 
Although limited in acojJCj its findinga may point the way to arena which 
need development. 

lieceived February 0, 
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The Value of Aptitude Tests for Factory Workers in the 
Aircraft Engine and Propeller Industries * 

John T. Shuman 

Tecftmcai halHvle, TTiWiainapori, Vcnnsylvania 

The general problem of this investigalion might be 8tat(5d ag followg; 
to develop a testing program for a company manufacturing radial and 
opposed types of aircraft engines, and to investigate the feasibility of 
using these same tests for upgrading the supervisory forces of three 
dissimilar companies of the same parent corporation. 

Both factory and auperviaoty joba we investigated at Lycoming 
Division—The Aviation Corporation. This industrial plant manufac¬ 
tures aircraft engines involving all the jobs necessary to the precision 
machining of engine parts. Only the supervisory jobs were investigated 
at ft foundry, Spencer Heater Division—^The Aviation Corporation, and 
at a propeller plant, The American Propeller Corporation. 

More specifically the investigation was designed to determine whether 
teats at the Lycoming engine plant would: 

0 . Assist in the selection of new employees without previous experi¬ 
ence in this type of industrial activity. 

6. Assist in the selection of new employees for work in fields as ma¬ 
chine operation, inspection, engine testing, the more skilled production 
jobs. 

c. Assist in the selection of new employees to be trained os skilled 
workmen, as tool room workers, tool designers. 

d. Assist in the problem of upgrading and promoting employees to 
supervisory positions. 

6. Assist in the better adjustment of employees. 

The investigation was further designed to determine whether these 
flame tests utilized in the Lycoming plant could be used to assist in the 
problem of selection, and promotion of employees to supervisory posi¬ 
tions in all three of the plants studied. 

* An Abatiftotf oj a diBsertation submitted in partial lulfillment of tho requiremonta 
for the degree of Doctor of Education at The Pennsylvania Stato College, February, 
1044, The author wiahea to aohnowlcdge the helpful suggcgbioiis received from Dr, 
B. V. Moore, Dr. C. C. Peters, and Dr. P. H. ICoi» in connection with various phaaos 
of the investigotion. A second artide dealing wilh flupervisors will follow in the noJtfc issue 
of J. appl. Psychol. 
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Criteria for Measuring Job Success 

A job rating made by the worker’s superior was utilized to measure 
success on the job. 

Each workman was rated good, a'mage or poor on his job. If he 
hud been transferred from one job to another, the reason for the transfer 
was ascertained. 

The employee's immediate supervisor was also asked what good and 
poor points the ratee exhibited. The reason for transfer and the com¬ 
ments were used as checks on the rating; if they did not parallel the 
rating, the supervisor was checked to determine the reason for the 
difference. 

The criteria used were the best possible for this particular situation; 
and the work of securing the criteria was carefully executed. Ratings 
were secured by several trained workei's who contacted personally super¬ 
visors familiar with the ratees. No rating was made unless one or more 
supervisors thoroughly familiar with the work of the ratee could be 
found. Because of "war conditions" inside the plants this was some¬ 
times difficult and criticaL 

The reliability of the criteria was found in two situations. These 
checks were made by having a trained departmental instructor rate the 
operators, and then securing a rating through the production supervisor 
as explained above. The reliability coefficients secured were: Produc¬ 
tion Engine Testers, .91 (N-42); Inspectors, .705 (N-36). 

Procedure 

Test results were secured in two ways. Some groups of experienced 
operators were tested. Each of these operators had six months or more 
experience on a j ob, and it was assumed that he had proved satisfactory 
on that job or that he would not have been allowed to remain on it. 
Ratinga were secured on tti®e groups in the usual way after testing. 

New applicants for jobs also were tested. Those applicants who were 
successful in securing jobs were followed up after six months or more in 
the plant, and ratings secured on them. 

The following tests were used in the inveatigatiOn: Otis Quick-Scoring 
Test of Mental Ability, Beta, Form A; Revised Minnesota Paper Form 
Board, AA; Bennett Teat of Mechanical Comprehension, Form. AA; 
O'Rourke Test of Mechanical Ability, Jr. Gr.; and Minnesota Vocational 
Test for Clerical Workers, Number Comparison. 

The use of the O'Rourke teat was abandoned early in the investiga¬ 
tion because of its length, and because it proved to be almost useless with 
female applicants, many of whom simply didn't try to take it, Further, 
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as more and more persona were hired from other than industrial occupa- 
tiona, the basis for this test seemed not to be suitable- 

The value or effectiveness of the trats is assessed in terms of simple 
percentage figures indicating the extent to wJiicli their use increased the 
effectiveness of the current personnel procedures. That is, by how much 
will the tests increase the effectiveness of the present hiring job as shown 
by the percentage of good operators hired. 

Although it ia believed that tJie correlation does not give a true picture 
of the results, they are also presented in the form of biserial r’a for those 
technicians who prefer to think in these terms. 

Results are presented in a number of histograms and tables. Sum¬ 
maries of the tables are given here, 

Table 1 presents a summary of the recommended minimum critical 
scores and the per cent improvement effected in the selection of excellent 
workers. 

Table 1 


Improvement Effected in. Seleobion of Excellent Workers by Selected Minimum 
Critical Scores, Lycoming Division—The Aviation Corporation 



Otia Q.S. Test of 
Mental Ability, 

Beta A 

Minnesota 

Paper Form 

Board, Rov. 

BotinotbTosb of 
Mcoh. Compre- 
hoiiaion, AA 

Minimum 
Job Cpitioal 

Group Score 

% Im¬ 
provement 
Selection, 
Excellent 
Workers 

Minimmn 

Ontieal 

Scoro 

% Im¬ 
provement 
Selection, 
Ei^allccit 
Workers 

Minimum 

Critical 

Score 

% Irn- 
proYoment 
Selection, 
Excellent 
Workers 

Toolmaker 

learners 

(N-64) 

61 

9 

33 

7 

36 

6 

Inapeotore 

(M<feF) 

(N-49) 

61 

37 

37 

29 

U-U 

12 

Engine 

testers 

(N-46) 

49 

19 

21 


F-IO 

33 

38 

10 

Job setters 
(N-26) 

34 

17 

30 

30 

36 

47 

Foremen 

(N-e&) 

3fi 

9 

24 

8 

30 

10 

Machine 

operators 

(M&F) 

(N-Bl) 

31 

10 

21 

8 

M-27 

22 






F-18 

12 
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Table 2 


AveraKo Improvement Effected in Selection of Excellent Workers, All Jobs, 
Lycoming Liviaon* 


Test 

Mean Improvement in 
Selection Excellent 
Workers at Minimum 
Critical Score 

Mean Improvement in 
Selection Excellent 
Workers atQi 

Bennett Tost of Mechanical 
Comprelienaion, AA 

18.2% 

19.0% 

Otis Teat of Mental Ability, 
Beta Test, Form A 


18.2% 

Revised Minnesota Paper 

Form Board, AA 

13.0% 

14.0% 


* The means given in the Table are not weighted by the N'a but arc averages of 
percentages by job categories. This was done because the moan of the different job 
categories and nob of the number tested was desired. 


Table 2 was developed by the simple expedient of averaging the 
results secured by each test for all job categories in the Lycoming Plant 
(see Table 1). Table 2 gives the mean per cent of improvement in 
selection effected at the various Minimum Critical Scores and at Qi. 
These means indicate that the Bennett Teat was on the ^vhole the most 
effective of the three, witli the Otis Test next and the Revised Minnesota 
Paper Form Board the least efficient. 

Table 3 

Corrolntions Between Job Ratings and Test Scores, Lycoming Diviaion— 

The Aviation Corporation 


Biserial r 


Job Group 

Otia Q.S. Test of 
Mental Abiliby, 
Beta A 

Minnesota Paper 
Form Board, 
Revised 

Bennett Test of 
Mechanical Com- 
prehenaion, AA* 

Inspectors 

.52 ±.09 

.50 ± .09 

.665 ±.13 

Engine tcstCTS 

.67 ±.13 

.16 ± ,17 

.17 ±.17 

Machine operators 

.48 ±.08 

.38 ± .08 

,44 ±.08 

Foremen 

.30 ±.07 

.47 ± .07 

,405 ± .07 

Job Betters 

.•16 ±.14 

.59 ± ,13 

,73 ±.10 

Tool room learners 

.485 ± .00 

.42 ± .09 

.46 ±.09 

Mean bisr** 

.49 ± .035 

.l-l ± .04 

,52 ±.03 


* All corrolfttionH in tiiis column arc for male only. The inapectora and machine 
operatora are the only two categories ollcctcd. All otlier job groups have no female 
workers. 

** The method uaed (or averaging wna that recommended by Garrett, Slotisiics in 
psychology and education, Longmans, p. 284. Each r was squared, the squares averaged, 
and the square root extracted of the average thus obtaimed. 
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Averaging the r's in Table 3 aeema a justifmblG procedure because 
the r-'e did not differ greatly in siie and one of the objectives of this 
investigation was to determine to whnt extent certain tests exercised 
discrimination in a relatively large number of job clnssificntions. 

Conclusions 

1. The three tests most extensively used selected excellont workers 
in the following order reading from the moat to the least GficcLive; that 
is, the Bennett Test was the moat eelective, the Otis next, and the 
Minnesota Paper Form Board the least efficient of the three. 

2. Job-auccesa on the purely manual-type job in the Lycoming plant 
shows no relation with the test scores. Discussion of these j obs hna been 
omitted from this report. 

3. Job-success on the jobs requiring skill, such as macliining pre¬ 
cision partSj testing aircraft engines, and inspection wag found to relate 
positively and significantly with the test scores, in varying percentages 
or degrees. 

4. The large range of aptitudes found in the industrial plant studied 
indicates that tests might best be used for assignment of employees to 
a job category or level rather than to specific joba. In other words the 
function of a testing program should be primarily the better adjustment 
of workers, 

6. The Minnesota Number Checking Teat used in. studying Produc¬ 
tion Engine Testers Beems not to have a ^vide enough application on other 
types of work to warrant its use with other groups. 

6. Under tight labor conditions tests in general must be usable with 
both men and women. A test such m the Bennett Teat of Mechanical 
Comprehenaion, if usable with both men and women with little variation 
in range, would be much more valuable in many cases. 

ileceioed Kerch 15 , Jd44' 



Studies in International Morse Code 
4. A Note on Second-Level Training in Code Reception 

Fred S. Keller 
Unitersily 

In the first pn-per of this sories/ there ^Yaa described a new procedure 
for teaching beginnera to recognize the thirty-six principal signals of 
International Morse Code. Essentially, this procedure involves the 
presentation of an auditory signal to the student and a subsequent 
identification of the signal by the instructor, with a short pause between 
signal and identification, to permit the student to write down the appro¬ 
priate character (letter or digit). The signals are transmitted and 
identified individually; one hundred signals, arranged in random order, 
constitute a practice "run,” after which the student is given a brief 
rest-period in which to sum his errors and enter the total in a “box-score’' 
record. 

Although no sharp line may be drawn between this early training in 
the accurate recognition of individual signals and the later practice in 
alow-apecd reception of a aeries of signals, it is convenient to distinguish 
between the stage in which the fundamental stimulua-reaponse relation¬ 
ships are established and that at which speed of response becomea all- 
important. The former may be termed "first-level,” and the latter, 
“second-level,’’ training. 

The present report is concerned with two variations of a method of 
second-level training which have proved to be effective in bringing atu- 
denta of college age from a code speed of five words* per minute (5 w.p.m.) 
to speeds as high as 20 w.p.m. in less than fifty-five hours of instruction. 
In either form, this method differa from those commonly used in training 
centers, in that (1) it provides the student wiUi knowledge of his progress 
at practically every moment throughout the entire period of instruction; 
(2) it encourages close attention to all signals transmitted within any 
practice session; and (3) it provides regular rest pauses at increasingly 
frequent intervals na the student advances in speed. 

' Kellor, F. S. Studies in International Motac Code. I, A now method of teaching 
code reception. J. oppl Psychol., 1043, 27, 407-415. 

* A "word” ifl here treated oa ony five-character group of letters and digits randomly 
arranged—e.g,, AR24P, B8GIIX, etc. 
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Variation 1. The first variation of this method requires as many 
operators or automatic sending-machines as there are differeut speeds at 
which students within a group arc qualified to work. In a class of 
twenty or thirty college students, with available coclc-spceds of 5, 7, 10, 
12, 16, and 20 w.p.m., more than three instructors nro seldom needed 
in order to meet the problem of individual difference in progress; Init n 
larger or less homogeneous group of students might require the fjcrvices 
of four, or possibly five, operators transmitting at as many different 
speeds. 

Following the satisfactory completion of first-level training, the stu¬ 
dent is introduced to a fi-w.p.m. rate of transmission. Signals continue' 
to be sent in runs of one hundred each, with all characters represented 
with equal frequency, in haphazard ajvangemenfc. The signals are not, 
however, individually identified by the inaliuctor ns in first-level training. 
Instead, at the end of each nm, lie "colls back" the phonetic equivalents 
(Able, Baker, Charlie, Dog, etc.) of the signals just transmitted, and the 
student checks, or corrects, Ills erroneous or omitted characters. The 
same practice sheets are used, and error tot-als are recorded in the same 
box-score form, as in first-level training (1, see Figs, 1 and 2), 

At a 6-w.p.m. rate of transmission, a run of signals requires four 
minutes, and four or five minutes may be consumed in checking errors, 
as the characters are called back, and in recording scores. It is usually 
possible to transmit five runs within a fifty-minute practice session. At 
higher rates of speed, of course, a larger number of runs may be given, 
although the between-run interval remains fairly consinnt. 

Students are advanced from one speed to another as soon as they 
have reached some arbitrarily chosen degree of proficiency. The results 
reported in this paper are based upon a maateiy criterion of three suc¬ 
cessive rung in no one of which the student made more than five errors 
or omissions. This was also the criterion of first-level proficiency, as 
well as that in the procedure next to be described. 

Variation 2. This variation of the caUing-back method may be 
employed when a single instructor, working with a single sound source, 
is required to give instruction to a group of students. It is usually 
introduced while first-level training is stUl going on, and it differs from 
Variation 1 only in that it calls for the ti'anamission of signals at different 
speeds to the same students during the some class hour. In order to 
accomplish this, the instructor may proceed, in stepwise fashion, from 
the slowest to the highest speeds at which big students are able to Work, 
giving most practice at the speed suitable to the greatest number of 
students. Thus, when a few students have qualified at the first level of 
training, a single run of 5 w.p.m. may be introduced at the end of the 
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class hour; wlicn more stuclenta rencli this level, more 5-w.p.m. runs may 
be added; when the 5-w.p.m. speed ia mastered by some students, a 
7-w,p.m. run may be iiiti-oductd; vM. m on throughout the training 
period. As soon as all of the students, or nil but one or two, have quali¬ 
fied at the lowest speed in use, then, of courac, that speed may bo omitted 
entirely. 

Table 1 

Progrciw of Two Groiipn of College »Sludcnla in Receiving Morso Code under Two 
Viiriiitloiw of Second-Level Instruction 


Speed 

(w.p.m.) 

Group I 
(Variation 1) 

Group 11 
(Variation 3) 

IIOUTS’* 

(fiO-iiiiiiuto) 

Number of 
SLudenta 

ylourg* 

(50-rainute) 

Number of 
Students 

6 

17,8. 

40 

18 

6G 

7 

2S.1 

3B 

25.4 

66 

10 

35.0 

33 

37.5 

65 

12 

41.7 

22 

61,5 

24 


*Tlio vnliiCH in tho "Hours'' ctrfiimna nro cumulalivo. Tho decreaging number of 
studentg at higher code speeds is due in part to withdrawal of students from college, 


Table 1 pro,scuta aomo illustrative data on the total training time 
required for students to qualify at four successive levels of code speed 
under the two conditions described above, Code classes were held one 
''hoiu'” daily (50 miniitoa), five days a week, and the practice periods 
were devoted wholly to receiving. All students were inexperienced in 
code at the beginning of training and all but three or four were able to 
master the 10-w.p.ni. speed before the course was ended, A few men 
reached the 15-w.p,m. level and one reached 20 w,p.m., in less than 
fifty-fivo hours, but tho number is too small to warrant tabic entries. 
Three men only failed to qualify at 5 w.p.m. The difference between 
the means for the turn group.s ia in part due to the fact that, under the 
second variation of procedure, the slower men were retarded because of 
the infrequency of runs at the speed which they were seeking to master. 

Received I'ehTUOnj 23, 



Job Specifications in Applied Psychology 

Note- The editor will be glad to reooivo job deaeriptiona and Hpecifientiona 
k the fields of applied psychology. These will be publiehed from time to 
time to provide information (or students, applied psychologists, omployera, and 
employment agencies. 

Personnel Technician (Testa and Measurements) * 

IntTodiiction. This aeries includes nil olaeses of positions, the duties 
of which are to construct and administer or eupervisQ the construction 
and administration of psychological measures, including aptitude teats, 
intelligence testa, achievement and trade teats, queationnairea, rating 
scales, etc., to be used as aids in the aelection, placement, training, and 
promotion of civilian and military personnel. 

It is believed, that the following atatementa of standards for the 
positions of personnel technicians (testa and measurementa) cover the 
majority of operating positions in tho War Department field service. 
Positiong of higher grade are found on the staff level, These staff posi¬ 
tions involve the formulation, of policy and procedures to be used in tho 
construction and administration of psychological measures throiigliout 
the War Department. 

Two general types of positions operating in the War Department field 
installations are representative of classes properly allocable to this series t 
1, Poaitiona involving the construction, validation, and standardization 
of psychological measures. 2. Positions involving the administration, 
scoring of psychological measures, and the interpretation and application 
of the results of these measures to the placement, training, and'promotion 
of civilian and military persouneL 

positions in the Personnel Technician Series may be allocated from 
grades P-1 through P-5 depending upon the following factors which are 
interrelated and should not be considered independently; 

1. For positions involving the construction of psychological measures. 

a, Degree of instruction and guidance given incumbent by superiors. 

b, Presence and degree of reaponaihility for technical accuracy of 
completed projeota, 

c, Preaence and degree of responsibility for planning and direction of 
program and projects. 

• Tlieae job epecificatione were prepared by the Salary aod Wage Adminjatration 
Branch, Civilian Petaonticl Division, Office, SecMtery of War, for use in ola, 9 aifyjng civih 
ian positions in War Department field establishinenk. 
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d. Reaponsibiliby for training otiier personnel technicians of lower 
grade. 

c. Amount of psyoliologicnl knowledge required in the performance of 
flsaigiimonta, 

2. Tor positiona involving the administration of psychological meaa- 
\iTea. 

a. Degree oC uistmcLian and guicUmec eaucerrviwg technieiil proceduiea 
given iucuvnbeut by supeviovs. 

b. rresonce and degree of responsibility for recommendations con¬ 
cerning placement, training, and promotion of personnel tested. 

c. Degree of interpretation and application of test i'csqUs, 

d. Presence and degree of individual accountability for accuracy of 
results, 

e. Presence and degree of rc.sponsibility for i)lanning and direction of 
program, 

The following definitions may aid in the complete understanding of 
tliGso standards; 

Aptihide test. One wliicli predicts detTco of success or failure in some 
field or activifcy, 

Achieiamcnt test. One which cloterminos level of skill or range of 
information which an individual has acquii'ccl. 

Objeclivc test. Short item tests in which there is little disagreement 
among those who itnow the subject niatlor concerning correctness of 
answer, 

Ocneral dbilily. ftoiionil intelligonco or classifiealioii test—a group 
or battery of teshy sueli a,H vooiibuUu’y, goneml information, arithmetical 
reasoning, and siiatial rclation.4 which inca.^ure the grade or level of the 
individual's niontiil ability. 

Validity. The degree to wliicli a tost measures the traits or trait it 
purports to nuniHUve. 

Reliahilily. The degree to which a test produces the same results or 
score upon retest, 

7/om, The di.sUilnition of seoro.s obtained from a rGpresentative 
sample of the iJopulalion fur which the Lest is designed. 

Process of standardization. Involve.s the dctcrnihmtioii of the validity 
and reliahilily and the ('.staldi.slunent of iiorin.s for p.syehological te8t,s, 

iikill. A developed or ticfpiirod ability to i)erfonn a task, group of 
toskfl, tnuh;, oi' ci'iift, 

Test haltcry. A combination of carefully ficleetecl tests designed to 
determine certuiu uj)Lilud(;.s, abiUlievS, achieveincnts, or skills. 

Per/oniiaacc Irst, A type of mental test iu which the role of language 
ia greatly reduced, the test material consisting of concrete objects or 



166 


Job Svecifications in Ayplied Psychology 

pictures, and tile responses oonaisfcing of manipnlation or nssemliling of 
these objects, e.g,, meclmnical assembly test, work sample. 

Correlation technique. A statistical method applied in obtaining the 
degree of relationship existing between two seta of measureg, such as test 
scores. There are several types of correlation techniques. For example, 
biserial, tetraclioric, multiple, partial, etc. Each technique utilizes li 
different statistical formula. The determination of the apccifie technique 
to be used depends on the nature of the problem, the data arailnblo, and 
the degree of accuracy and form of results desired. 

Central tendency. A measure or score representing the middle of a 
group, e.g,, mean, median, or mode, 

DisferHon. The extent to which a group of measures such as test 
scores vary from central tendency. 

Personnel Technician, P-1 

The area of responsibility of grade P-1 personnel technicians is limited 
by specific instructions and continuous technical siiperviaiou by pro¬ 
fessional personnel of higher grades. Incumbents at this level usually 
serve as trainees in order to become familiar with the techniques and 
tools necessary to perform more reaponaiblo work in the field of psycho¬ 
logical test construction and administration. All of their work is re¬ 
viewed for technical adequacy, accuracy, and eonformance to standard¬ 
ized procedure. 

Personnel technicians at this grade collect background material con¬ 
cerning the subject, trade, or skill for wliioh the test, rating scale, ques¬ 
tionnaire, eto., is to be constructed. Following outlined sources of 
material, they study technical manuals and other sources of occupational 
information, and interview foremen, supervisors, and akilled worlcera in 
the field analyzing their jobs in order to determine the essential skills 
and steps involved in the adequate performance of the work. They 
perform assigned statistical analyses of data from test studies conducted 
in the field and on tests conati'Ucted by other members of that unit as 
part of the test standardization process. Following defined procedures, 
they apply simpler statistical techniques such as correlation formulae to 
test data in order to determine the reliability and validity of tesla. 

Grade P-1 personnel technicians, following specific instructions con¬ 
cerning test specifications, subject matter to be covered, types of items, 
w'eights, time element, etc., construct objective test items for a variety 
of subjects, trades, or skills. They may edit test items for conformance 
to the accepted style (choice and arrangem^t of words) written by other 
personnel technicians at this grade, following detailed instructions and 
Samples of itema. 
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Personnel teclmicinns in this class, applying their professional educa¬ 
tional background and following npecific instructions, analyze, evaluate, 
and abstract pertinent material rela-ting to test construction and testing 
procedures from scientific and professional journals. 

Grade P-1 personnel technicians functioning in a testing unit admin- 
iatcr and score a variety of individual and group testa of aptitudes and 
abilities following specific instructions concerning choice of testa and 
metliods of administration and scoring. While working at this level, they 
receive instruction and guidance from, peraounel technicians concerning 
interpretation of test results and application of these results to the place¬ 
ment and training of personnel. 

Personnel Technician, P-2 

Grade P-2 personnel technicians work under supervision of personnel 
technicians of higher grade, receiving instructions concerning the general 
procedures and techniques to be followed in completing an assigned 
project or portion of a project, but working out details on own initiative, 
and selecting a specific technique from several standardized procedures. 
Grade P-2 personnel technicians, although advanced beyond the pre¬ 
liminary training period, are given training and instruction on the more 
difficult phases of their assignments. Their work is reviewed for tech¬ 
nical adequacy, accuracy, and conformance to standardized procedures. 

Personnel technicians at this level select sources to be used and collect 
and analyze technical background matcml coneoTning the subject, txadD, 
or skill for which the test, rating scale, questionnaire, etc., is to be con¬ 
structed. They conduct interviews with foremen, supervisors, and skilled 
workers in the field, analyzing their jobs in order bo determine the essen¬ 
tial skills and steps involved in the adequate performance of the work, 
Following established criteria, they select significant factors from the 
information gathered and they convert job information into valid objec¬ 
tive teat items. 

Grade P-2 personnel tecliniciana, following instructions concerning 
teat specifications, general format of test, .subject matter to be covered, 
types and number of items, construct objective test items for a variety 
of subjects, trades, or skills, They may edit test items written by other 
personnel technicians at this grade for conformance to the accepted stylo 
(choice and arrangement of words). 

Personnel technicians at this grade wiitc manuals of directions for 
examiners and instruction.s for examinees following format and outline 
used in previous test manuals. 

Personnel technicians at this level perform statistical analyses of data 
from test studies conducted in the field and on tests constructed by other 
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members of the unit in order to standardize the testa. Specifically, they 
determine which formulae.to apply to an assigned problem after general 
plan for statistical study has been outlined by personnel technicians of 
higher grade. 

Grade P-2 personnel technicians functioning in ii testing unit admin¬ 
ister, score, and interpret a variety of individual and group teats of 
aptitudes and abilities, i.e., achievement and general intGliigence. At 
this level personnel technicians select tlie appropriate teats to l)o admin¬ 
istered to personnel being considered for placement, training, transfer, 
or promotion iu order to determine present level of skill, aptitude, suita¬ 
bility for employment, and need for training. The tests are selected on 
the basis of information obtained by the placement interviewer and on 
the knowledge which the incumbent Iiaa of the uses of specific approved 
tests in relation to success in the various occupations. Personnel tech- 
niciana at this grade make pieliimnopy teeommendations to the personnel 
technician in charge of a testing unit concerning the accepbnbility, place¬ 
ment, and training of the Individuals tested, after interpreting the test 
results. 

Personnel Technician, P-3 

Grade P-3 personnel technicians receive general instructions concern¬ 
ing objectives of projects but work out details of assignments on own 
initiative. Their work is reviewed for conformance to technical pro¬ 
cedures and established objectives. Personnel technicians at this level 
review and edit test items prepared by lower grade teclinicinns. This 
review is made in order to determine whether or not the items of the test 
conform to established principles and patterns of test construction, are 
ivritten in clear English, are free of objectionable content, and of a suffi¬ 
cient level of difficulty for the group to bo tested, but not too difficult to 
be of value in differentiating the group. 

Grade P-3 personnel technicians following an established plan and 
purpose for a test or a battery of testa constiuct objective testa covering 
a variety of subjects, trades, or skills, and write manuals of directions for 
examiners and instructions for exanunees. 

Personnel technicifl.ns at this grade review job analyses and trade 
test items prepared by personnel technicians of lower grade in order to 
determine whether or not the aignificant factors concerning the job have 
been covered by the test items. In performing this function they draw 
upon their knowledge of jobs and trade testa previously constructed and 
validated. 

Grade P-3 personnel technicians make field trips to posts, camps, and 
stations in conjunction with personnel technicians of higher grade for the 
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purpose of administering individual testa of mechanical and other apti¬ 
tudes, and obtaining data for tl^o purpose of validating tests by com¬ 
paring teat Bcorea with efficiency ratinga and other personnel data, 

Personnel tefllimcianvS at this level are reapotwible for statistical analy- 
HiB of teat data. Tliia function involves selecting specific statistical tech¬ 
niques that pertain to the problem from several accepted methods. 

Personnel technicians at tliis gi’iide assemble and organize information 
for a project report indicating procedures used in gathering facts and 
preparing lists of data obtained, analysis of statistical results, validation 
and standardization techniques and norms established, or conclusions 
reached from the study. 

Grade P-3 personnel technicians may function as assistant chiefs of 
placement testing units in iuBtullations having a large variety of complex 
jobs. In tills capacity they determine work assignments for persDiinel 
technicians in tlic unit on the basis of knowledge of individual techni- 
oian'B experience and qualifications. They discuss these assignments with 
personnel technicians of lower grade and make decisions concerning teats 
to be administered and recommendations to bo made in instances where 
the subordinate personnel technicians cannot make the determination. 

Grade P-3 personnel tecliniciane may also function as chiefs of ploce- 
ment testing units in installations liaving a smaller voricty of routine and 
Bcmiroutine jobs. They are responsible for tho development and admin¬ 
istration of a testing program for improving the placement and training 
of employees in order to achieve tlic maximum utilization of manpower 
skills available to the installation. In this capacity they gdide and direct 
a group of personnel technicians of lower grade engaged in adrainiateving, 
scoring, and interpreting tUo rcaulta of aptitude, performanca, trade 
information, and general intoHigcncc teats. Personnel techniciana at bhia 
grade make recommendations to the placement and training branches of 
the installation's personnel office concerning the acceptability, placement, 
and training of the individuals tested, on the basis of the interpretation 
of test results and analysis of abilities, skills, and aptitudes of the 
individuals. 

Pemonncl Technician, P-4 

Grade P-4 personnel technicians function independently with regard 
to technical proced\ircs, bulwijrkin conformance with established policies 
concerning objectives to !)r necomplished. 

PerBonucl technicians at tiiis level arc assigned special studies re¬ 
quiring a broad background of psychological measurements and test 
construction techniques, i.e., evaluating tests and rating scales already 
in use by comparing results of different testa. They study groups used 



170 Job SpcoificGlions in Applied P&jjcholayy 

in original validation of testa and rating scales iu order to detennine 
what other groups can be tested by these measures. On the basis of 
these studies they submit recommendations to pcrsoiiucl technicians of 
higher grade for improvements in Bpccific tests and test construction 
techniques. 

Personnel technicians at this grade have tlic re.sp(jnMii)illby for tlie 
planning and completion of projects involving the coiiHlruction of tests 
and test batteries, questionnaires, mting scales, etc., which measure 
general ability, aptitude, or achievement to classify individuals on the 
job, classify them for specialwedtraining, or classify them within training 
groups, or evaluate the effectiveness of tho training program. They arc 
responsible for project reports which include procedures used in gathering 
facta and preparing tests, data obtained, analysis of statistical resulLs, 
validation and standardization techniques and norms cstablislicd, or con¬ 
clusions reached from, the study. 

The details of the test construction function inchide performance or 
the supervision of the following: 

a. Analysis of the job, field, ability, or skill for which the test ia tube 
constructed. 

h. Establishment of test specifications including tlie determination of 
the type of test to be constructed, the subject matter to be covered, tlie 
number of items, weights, time element, cte. 

c. "Writing of original test items. 

d. Organization of the items into testa. 

e. Detevmmation of the format of the test. 

/. Organization of the testa into batteiira. 

g. Selection of standardization groups and design of test tryouts. 

h. Planning and extension of statistical analyses for determining 
validity and reliability of the testa, teat batteries, etc. 

i. Planning and execution of follow-up studies on the tests constructed. 

Personnel technicians at this level accompany higher grade personnel 
technicians on visits to Army installations after requests have been re¬ 
ceived from auch installations for the establishment of personnel pro¬ 
cedures requiring the use and application of psychological monsvires. In 
conjunction with higher grade personnel technicians they analyze the 
test needs in terms of the types of jobs found at the inatallation anfl tho 
training and skills of the personiud of the installation. The testa may 
be used as aids in selection, placement, or promotion of personnel and the 
evaluation of the training programs. In making this analysis, tho func¬ 
tions and work flow of the inatallation are studied, personnel are inter¬ 
viewed, and administrative officials are consulted. After rccommenda- 
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tions concerning testing programs have been approved by the senior 
member of the team, they instruct installation personnel in uses ojf tests, 
methode of administration, scoring, and interpretation. They construct 
new testa when existing ones do not fit the problem at hand or adapt or 
extend norms of existing measuring devices to cover the installation 
personnel. 

Grade P-d personnel tcchinciana advise personnel technicians of lower 
grades concerning statistical procedures to be applied to particular, un¬ 
precedented, or nnusnal problems. They plan statistical techniques and 
steps to be used in the determination of the validity and reliability of 
testa, The steps include intcrcorrelaliona of a number of variables, 
measures of central tendency, measures of dispersion, selection of tlie 
minimum number of independent variables which will give maximum 
production of the dependent variable, item analysis by biserial or tetra- 
choric correlations and application of measures which indicate whether 
ov not differences obtained ate significant. When necessary, new statis¬ 
tical procedures are devised to meet special problems. 

Grade P-4 personnel technicians function as chiefs of placement test¬ 
ing units in installations having a large variety of complex jobs. They 
are responsible for the development and direction of a placement testing 
program in order to achieve the maximum utilization of manpower skills 
available to the installation. In this capacity they guide and direct a 
group of personnel technicians of lower grade engaged in admimstering, 
scoring, and interpreting the results of aptitude, performance, trade 
information, general intelligence tests, questionnaires, and rating scales. 

Personnel technicians at this grade make recommendations to the 
placement and training branches of the installation's personnel office 
concerning the acceptability, placement, and training of the individuals 
tested on the basis of the interpretation of t(^t results and analysis of the 
abilities, skills, and aptitudes of the individuals. 

Personnel Technician, P-5 

Grade P-5 personnel technicians act with independence in planning 
projects and in the development of methods and procedures for the 
conduct of these projects. They receive guidance concerning adminis¬ 
trative and technical policies and broad objectives of tl\e program, Their 
work is reviewed for conformance to tlmse policies and objectivea. 

Personnel technicians at this level may exercise administrative super¬ 
vision and technical direction over subordinate professional employees, 
making final decisions with respect to the most difficult and unusual 
technical procedural problems wliich arise. 

Personnel technicians at this grade visit War Department inatalla- 
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tiona after requeata have been received from such installations for the 
establishment of personnel procedures requiring the use and application 
of teata in order to increase the effectiveness of induction, placement, 
promotion, and training of civilian employees in clerical, mechanical, 
Bubprofeasional, professional, and aupcxviaory positions, In this capacity 
they analyze and evaluate the total personnel program in relation to the 
specific problem in order to determine whether or not the application of 
tests will alleviate the problem. When such study reveals that a testing 
program is called for, they select the appropriate previously constructed 
teats, or construct new measuring devices to meet the problem. The 
performance of this function involves the following: 

a. Analysis of jobs, flow of work, functional organizations, and train¬ 
ing curricula and standards. 

b. Evaluation of qualifications and performance of present incum¬ 
bents. 

c. Conferences and interviews wth employees, supervisory and ad¬ 
ministrative officials, and with the members of the staff of the installation 
civilian personnel office. 

d. Planning and developing of new test forms and procedures. 

fl. Preparation of manuals of direction for administration and scoring 
of tests and interpretations of results. 

/. Determination of adequate criteria for test validation and devising 
procedures for measuring individual job productivity, both qualitatively 
and quantitatively. 

g. Experimental tryouts of preliminary test forms, statistical analysis 
of data obtained, revisions for final test battery, and establishment of 
norms for group. 

h. Training of installation staff in method of administration and 
scoring of tests and interpretation of results, 

i. Conducting of follow-up studies of testing programs instituted in 
order to recommend revisions in etandards or in measuring instruments. 

On these visits to field installotions, personnel technicians at this level 
advise and assist manageinent on other phases of personnel administra¬ 
tion such as training, placement, and employee relations, applying their 
psychological knowledge and experience to the specific personnel prob¬ 
lems of the installation. 

Grade P-6 personnel technicians may plan, organize, and direct the 
work of a staff of professional employees of lower grades engaged in the 
construction and statistical validation of a variety of testa and tost 
batteries to be used in the selection, placement, training, and promotion 
of employees. 
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MoMurry, Robert N. Handling personality adjustment in industry. 

New York: Hfti'per anti Brothers, 1944, pp. xi+297. S2.50. 

The author states that this book is written to give business executives 
insight into the sources and solutions of problems in personnel adminis¬ 
tration and industrial relatione. Although this ambitious goal is not 
fully attained, the book will give a fresh point of view to any business 
leader who is progi’esaive enough to read and consider its eontenta. 
Perhaps the book’s greatest contribution, however, will be to give aca¬ 
demic industrial psychologists greater insight into actual industrial 
conditions, 

The material on labor relations is the outstanding section of the book. 
Several original and provocative ideas regarding labor-management rela¬ 
tionships are presented. The author contrasts the ineffective means of 
solving labor problems with some technique that have been effective in 
determining the true causes of strife: the exit interview, grievance com¬ 
mittee, employee opinion poll, and the home interview. 

For the most part, clinical psychology, psychiatry and psychoanalysis 
have neglected the industrial field. Industry, in turn, has not recognized 
the importance of the personality and emotional factors that affect it. 
The material in this book will help to remedy this situation. Many 
books on industrial psychology emphasize the meaBurement of aptitudes 
and intellectual factors. This book, on the contrary, emphasizes emo¬ 
tional and motivational factors necessary for success on the job. 

Much emphasis is placed on the diagnosis of personality disorders but 
very little attention is given to treatment techniques. No mention is 
made of non-directive therapy which is being used with good results in 
several industrial situations. The author points out that many business 
executives have personality problems themselves, but the suggestion is 
never made that these disorders might yield to treatment. 

Much of the material in the aections on selection and ti'aining is 
valuable although not related to the topic of personality problems in 
industry. The chapter on '"The Home Interview" is presented entirely 
as a selection procedure, aldiougli it would have been more relevant if 
centered around the theme of peraonality problems. 

The last thirty-three pages of the book constitute a manual to train em¬ 
ployment interviewers in the theory of personality. The psychological 
principles set forth are questionable in places, os on page 259 where we read: 
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"The emotions, on the other hand, do not need to mature. Tliey func¬ 
tion perfectly nt birth. The day-old infant experiences rage and fear as 
intensely as does the adult. In short, emotional reactions do not have 
to be learned.” 

Business and academic people interested in human relationships in 
industry will derive considerable help from tiiia book. 

Charles C. Gibbons 

Owejis-IUinoii Glass Coinpany 
Toledo, Ohio 

Gallup, George, A guide to public opinion polls. Princeton: Princeton 

University Press, 1944, pp. xviii-1-104. S1.50. 

Applied psychologists will welcome this book because it contains just 
the type of information to which skeptics or the uninformed may be 
referred when they desire to learn something about this relatively new 
technique. It deals with twelve general topics such as the function of 
public opinion polls in a democracy, the cross section, formulating ques¬ 
tions, size of the sample, and polling accuracy. 

The plan of the book is novel and effective. From the first page to 
the bat, it gives a series of questions together with brief answers. The 
total number of questions ia 80 covering almost every conceivable aspect 
of polling. The answers, though brief, are straight-forward, factual, and 
convincing. 

In dealing with the question of accuracy in the prediction of elections, 
Gallup makes out a good cose for the steady reduction of error from the 
notorious 19 per cent error of the lAterary Digest in 193G to the one or two 
or three per cent errors in the prediction of elections in later years, In 
the opinion of the reviewer, however, this problem ia not faced with 
complete candor. The consbnl errors in the Literary Digest fiasco are 
described at some length but the presence of such constant errors in the 
Gallup 1940 presidential election poll ia not mentioned. The reviewer 
refers to the fact that the 1940 Gallup poll underestimated the Roosevelt 
vote in state after state. Surprisingly enough, the Gallup poll was unable 
to overcome this type of error in 1944 when it overestimated Roosevelt’s 
vote in ten states and underestimated it in 38. But this specifio defect 
should not blind one to the general accuracy and the widespread utility 
of the Gallup poll and of other equally reliable polls, They arc important 
instruments in ascertaining public opinion not only with respect to social 
and political issues, but also in market research, industrial relations, 
education, and all other fields where opinions, beliefs, and attitudes must 
be taken into consideration in dealing with human beings. 

Donald G. Paterson 


The University of Minnesota 
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Dvorinc, laraol. Color pem'pim testing diaiis (FoL i); Color pmeption 
irainmg charts (7ol 2). Ilaltimoixi: Published by the author, 1944, 
S25.00. 

These charts arc of the pscudo-iaoeliromutic type. There are 60 
perception and 70 training plates, TesLs for naming colors and for 
training in color naming arc included. The colora employed are based 
on the flubtmetive color theory. The author erroneously lists the three 
primary colors as red, yellow and blue instead of red, green and blue. 
The perception test is not limited to investigation of red-green and blue- 
yellow dcficicucics but yields information on perceiving both primary and 
sccondaiy colora. The author congidera that some individuals who are 
listed aa color blind are only confused by certain color combinations, 
These, although classified as color blind, readily improve when given 
color perception training. It is claimed that these charts will avoid 
uncertainty and error in measurement of color perception. The only 
claasifications attempted from reapousea are: normal in naming and per¬ 
ceiving colors, correct naming with defective perception, incorrect naming 
and normal perception, incorrect naming and defective perception. 
There is no attempt to degignate a person as red-green color blind, etc. 

The training charts "educate” or coach people to name colora and to 
pass pseudo-isochromatic color-blind tests such as for the Navy or the 
Air Corps. It would seem that ike vtidespread use of these training tests 
would tend to nullify the usefulness of all pseudo-isochromatic tests of color 
vision. Miles A. Tinker 


Universitj/ of Minmsoia 



New Books, Monographs, and Pamphlets 

Crime and the human mind. David Abrahanisen. New Yorlc: Columbia 
University Pressj 1944. Pp. xiv 4- 244. $3.00, 

Dvorine Color Perception Training Charts. larael Dvorinc, O-D-, 2328 
Eutaw Place, Baltimore 17, Maryland. 2 volumofl. 130 colov 
charts. $25,00. 

Ahseniedsm: management’s ’problem, John B. Fox and Jerome F, Scott. 
Beaton; Division of Research, Harvard Buaineas School, 1943. 81.00. 

Conserving marriage and the familif. Ernest R. Groves. New York: 
The Maainillan Company, 1944. Pp. 13S. $1.75, 

From gods io dictators. Pryne Hopkins. Girard, Kansas: Ilnldeman- 
Julius Publications, 1944. Pp. 168. Paper $1,00. Cloth $1,65- 

Experiments on the effects of music on factory production, Willard A, 
Kerr. Applied Psychology Monograph. Stanford University; Stan¬ 
ford University Press, 1944. $1.00, 

Ps^c/iof/ierapy in vitdical pradica. Maurice Levine. Chicago; Mac¬ 
millan Company. Pp. xiv 4- 320. $3.50. 

Teamwork and labor iurnovet in the aircraft industry cf Soul/io'n California, 
Elton Mayo, George F. Lombard and aasociatc.s. Boston: Division 
of Research, Harvard Business School, 1944. Pp. 30, 24 charts, 
8 tables, $1.00. (Business Reacareh Studies No. 32,) 

Leaminp by exposure (o uiron^/arms in grammar and spelling. John R. 
Mointoah, New York: Bureau of Publications, Teachers College, 
Columbia University. Pp. 61. $1.75. 

Emotional factors in leurning. Lois B. Murphy and Henry Ladd. Now 
York; Columbia Univemity Press, 1944. Pp. x 4- 410, $3.50, 

Women and men. Amran Scheinfeld. New York; hlarcourt, Brace & 
Company, 1944. Pp. 453. $3.50. 

Psychodrama in the schools. Nahum E. Shoobs. New York 17; Beacon 
House, 1944. Psychodrama Monographs, No, 10, Pp. 19. $1.50. 

Glossary of technical terms. Calvin P. Stone, Stanford University; 
Stanford University Press, 1944. Pp. 16. $,25. 

A factorial study of perception. L. L. TTuu’stone. Clucago; Univevaity 
of Chicago Press, 1944. Pp. 148. $2.50. 

The place of reading in the elmenUity schooi program. Board of Educa¬ 
tion of the aty of New York. Educational Research Bidlotin No. 7. 
Pp. 43. 


170 



studies in Job Evaluation: II. The Adequacy of Abbreviated 
Point Ratings for Hourly-Paid Jobs in Three 
Industrial Plants 


C. H. Lawshe, Jr. 

Divimn of Education and Applied Psychology, Purdue University 


The growing importance of job evaluation ae a more objective ap- 
proadi to the Btabilizution of iiuluBlrial wage Btructures hoa manifested 
itself in the increasing degree' to which psychologists are concerning 
themselves with the varioua rating metlioda now in use. To examine by 
psychological methodology some of these job rating techniques has been 
the intent of tlio authors of this scries of papers, the first “ of which 


reported the identification of factors or clusters of items which appear to 
be functioning in one of the moat widely used job rating systems.® The 
purpose of the investigation reported in the present paper was to deter¬ 
mine the extent to which abbreviations of this system yield the same or 
comparable results and to examine any difTerencea in terms of practical 


sienificanco. 


Procedure and Results 

Method. Job rating data were collected from three plants which use 
the NEMA system or a slight modification of it. T’or each plant, mter- 
corretations between all eleven factors and total points were computed 
and a correlation matrix was prepared.'* 

‘ Herbert Mnore. Prolilema und melliods in job evaluation. J. conaull. Psychol., 


a'a lIwHlic, Jr., ni.d O. A- Snttor. SludicB in job evaluation. 1, Factor M&lyaes 
of point nitiuKH for liovirly-|>ai<l jobu in tlireo industrial plnuta. J. appl. Psychol., M , 
26 180-108 

‘^Job raiing; Dcjinilion of the factors used in rating jobs-homly rated 
Chicago: IndusLiial Ilclations DepartmonL, National Electrical Manufacturors Aflaocia- 


Thle malnlt together with dcscriptiona of the ihjeo planta and other ^rtinent 

data are presented in ths first of this BcricB of papers, C.H. wa e, r., an 
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€. IL Lawshc, Jy. 


The Wherry-Doolittlc ehrinkagc selection metliod aw reported by 
Stead Shartie; el al ^ was applied and the firat three Items vv^en* identified 
in each plant. The multiple E's ave presented in Tabic 1, 

TftbJe 1 


Correkfcion CocfRcients hotween Untinip) on Selected Ucins niid 'I’nliil Point ttntiiigs 


Selected RatinK Sciilc Items 

A 

riimt 

H 


Experience (or Lcnrning time) 

M 

.93 

.8B 

Experience (or Learning time) plus llaznnh 

.07 


,01 

Experience pins Initiative 

— 

.05 

— 

Experience (or Learning time) plusHnznrda 

p\uB Education 

,oa 

—• 

-- 

Experience plus Hazards plus Initintivo 

Experience plus Initiative plus Responsibility 



,93 

for the Safety ot OUv«re 


.06 



Items lde,niified. As ia shown in Table 1, the "experience or learning 
time!' item ia the single variable which correlates liigliest with "total 
points" in each of the three plants, the coefficients for plants A, B, and C 
being .96, .93, and .86 respectively. In plant A, when "hazards" is added, 
the multiple correlation becomes .97 and when "education" is added it 
becomes .98. In plant B, when "initiative" is added the correlation is 
increased to ,96 and when "responsibility for the safety of otlicrs" is 
added, the value is .96. For plant C, the multiple correlations arc in¬ 
creased to .91 and .93 with the subsequent inclusion of "hazards" and 
“initiative." 

It should be pointed out that in none of the three plants did the It 
start to shrink when the third variable was added, Howovor, the high 
value of the correlations, plus the fact that the increment resulting from 
the addition of the third variable is so email, makes further application of 
the technique seem unnecessary. The difference between thc-^e incre- 
ments added to the K’s by the third selected items as compared to the 
increment that would have been added by other items' is so small that 
congiderable sampling error could be piesent. For example, in Plant B, 
when, the correlations are earned to a third decimal place, tlic addition of 
"responsibility for the safety of others" to "experience" and "initiativo" 
increases the R from .963 to .962, an inci'cment of .009. Other items 
would have increased the obtained R by perhaps ,007 or .008. It Beems, 

* William H, Stead, Carroll L. Shortlej dL al. Occii^jflb’onal connselino iecluiiques, pp. 
245-262, New York'. The Amoriean Book Genapany, 1940. 





Sludiesi in Job Emlmlion: 11 


179 


then that too mucli iniporinncc sliould not be attached to the particular 
item that waa added last. In spite of this fact, however, Table 1 shows 
a certain consistency from plant to plant in the particular items that wore 
selected. In the three varialjlea selected, "experience or learning time’' 
appears in all plaiiis, always first, while “hazards" and "initiative" each 
appear in two oC the planta. 

Accuracy of Predidion. Tabic 2 lists the standard errors of estimate 
for predicting Llie total point rating in each plant from one, two, and three 


Table 2 

Hliindiu'd ICrrors of KsLimute for Tredicting Total Point 
Iliilinp from Selected Scale Items 


Selected Items 

Plant A 

Plant B 

Plant C 


% 

ffcal. 

% 


% 

Beet Single Item 

17.4 

30 

17.0 

37 

5.4 

51 

Best Two Iteiii.s 

13.7 

24 

14.4 

30 

4.5 

42 

Best Three Items 

11.4 

10 

13.0 

27 

3.8 

30 


items in the rating scale. For example, iJie standard error of estimating 
the total point rating for a particular job from tlie best three items is 
11.4 in Plant A, 13.0 in Plant B, and 3.8 in Plant C. In other words, in 
Plant A, the estimates for approximately two-thirda of the jobs are within 
11.4 of the total point rating baaed on all eleven factors. The percentage 
figures in Table 2 iudicato the proportional size of the errors in terms of the 
standard deviations of the several distributions. 

Practical Implications of Grade Placement 

Application of Abbrenated Scale. In the plants studied, how many 
jobs would actually be shifted insofar as rates of pay are concerned if an 
abbreviated scale were used? Is the standard error of estimate of 11.4 in 
Plant A practically significant? This question can best be answered 
through an analysis of the changes that would actually occur if only three 
items were used. 

Prediction Formula. Plant A has been selected as an example. TJa- 
ing the data from this plant, the regrossion equation for predicting total 
points from “experience or learning time," “hazards," and “education" 
was found to bo: 

Xtp = 30.4 -j- 1.4 b*p. "H + 2.0ei1uo. 

Point ratings on “experience or learning time," “hazards" and “educa¬ 
tion" were substituted in the formula for esich of the 247 jobs in the plant 
to obtain the computed ratings. These computed values arc shown 
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plotted against the total point ratings (eleven items) in the senttergram 
(representing the previously mentioned R of .98) in Figure 1. Super¬ 
imposed over the scattergram are eleven shaded areas, each representing 
a different labor grade. For example, jobs which “rate" from 144 points 
to 165 points are in the second labor grade. Any job which falls inside 
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total point .flATINQ -eleven ITEMS 


Fia. 1. Graph, ahowing ratinga computed from three scale iteina plotted against 
total point ratings (all eleven itema) for 247 jobs in Plant A. The eleven shaded areas 
define the labor grades designated by the numbered arrows. 


a shaded area is placed in the same labor grade by both the original scale 
and the abbreviated eenJe^ and any job which falls in an unshaded aroa 
would be displaced one or more labor grades by the abbreviated scale. 

Labor Grade Displacement. Table 3 shows that of the 247 jobs in this 
particular plant, 153 or 62% would remain in the aume labor grade, 92 
or 37.2% would be displaced by one labor grade, while only 2 jobs or 
0.8% would be displaced two labor grades. Table 3 also shows the 
number of jobs deviating by varying numbers of points, classified as 
"same labor grade/' “displaced one labor grade," and “displaced two 
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Tablo 3 

Diacrcimncics between Total Point natidgs (Eleven Items) and 
IlfttingH Computed from Three Ilcma for Plant A 


PointsS 

of 

Dcviiitioii 

No. ol Jol)3 by Labor Graclo Displacement 

Same 

Labor 

(iradc 

Diaplnccd 
Ono Labor 
(Imdc 

Displaced 
Two Labor 
Grades 

All Jobs 

0^ 

OK 

0 


77 


4K 

27 


75 


20 

28 


48 


11 

21 


32 


U 

2 


8 

25-29 


4 


4 

ao-34 


1 

1 

2 

35-30 



1 

1 

Totals 

153 

02 

2 

247 


labor grades." Tliis table and the data from which it was prepared 
reveal that only seven jobs deviate from their original placement by more 
than 22 points, the range of most of the labor grades. The fact that only 
seven jobs Itavc point differences greater than the diiTerenco between the 
highest rated job and tlie lowest rated job in any given grade, is additional 
evidence of the comparability of the two systems. 

Wage Structure Considerations 

Range of Rates. Examination of the rate schedule (Table i) in Plant 
A tends to minimize the practicol importance of such differences as would 

Table 4 

llttlo Schedule For Plftot A 


Rates 


Labor 

Grade 

Point 

llangc 

Starting 

Ono 

Mouth 

Two 

Months 

Maximum 

1 

Up to 144 

.65 

70 

.75 

.81 

2 

145 to 100 

.65 

70 

.75 

.87 

3 

107 to 188 

.70 

75 

,80 

.93 

4 

180 to 210 

.75 

80 

.85 

.99 

B 

211 to 232 

.80 

85 

.90 

1,05 

5 

233 to 2D4 

.85 

00 

.95 

1.11 

7 

255 to 270 

.90 

05 

1,00 

1,17 

3 

277 to 208 

.95 

100 

1.05 

1.23 

g 

200 to 320 

1.00 

105 

1,10 

1.20 

10 

321 to 342 

1.05 

no 

1.15 

1.35 

11 

343 and up 

1.10 

115 

1,20 

1.41 
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exist between the application ol the original scale and tlio abbreviated 
scale. The rate of $1.05 per hour, for example, is tlio maximum rate for 
jobs in labor Ei'ode five and ia earned by employees on Hojno jobs which 
are evaluated as low as 211 points. On the othei- hand, 31,05 is the 
starting rate for labor grade ten and ia paid to aomo employcoa on jobs 



76 100 122 144 166 166 210 232 264 276 298 320 3 4 2 3 64 386 408 


TOTAL POmi RATmO-ELEVEN ITEMS 


Fig. 2. Graph showing point range of jobg which at one time or another carry a rate of 
$1,05, Note that only seven joha fall in one shaded band but not in the other. 


that are evaluated as high as 342 points. This rate, then of $1.05, may 
be paid at one time or another to employees on jobs ranging through six 
different labor grades and evaluated at from 211 to 341 points, To be 
sure, a progression system is used and varying amounts of time are spent 
on jobs in these several labor grades when the $1.05 rate is paid. How¬ 
ever, the fact that a particular rate does occur in aix consecutive labor 
gi’ades tends to minimize the practical aignificilncc of a few points of 
difference on the scale. Figure 2 shows that nearly every job that falls 
within the 211 to 342 point range on one scale also falls within the same 
range on the other. 
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The Reliability of Point Ratings 

Praclical Difficulties. The reliabilities of the original ratings in the 
three planta investigated are not known just as they are not known in 
any plant. It is impractical if not impossible to obtain re-ratings of jobs 
by a second jury of equal competence or of equal familiarity with the 
jobs. For this reason, it is impossible to determine whether or not the 
correlation between the complete scale and the abbreviated scale is as high 
as the reliability of the scale itself. Needless to say the reliability of 
human judgments rarely attains the magnitude of the correlations pre- 
Bonted in Table 1, whether they be judgments of personality traits or 
of physical phenomena. 

Table 6 sheds some light on the reliability problem. In a fourth plant, 
the same jury of supervisors and analysts rated a group of five jobs on 
March 16, rerated them on March 22, and again rated them on April 7. 

Table 5 

Point Rntinga and Corresponding Rutes for Five Jobs Rated at Three Different Times 

Maximum 

First Unting Second Rating Third Rating Change 

Job Points Rate Points Rale Points Rate Points Rote 
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are ftlinoafc certain to exist force the conclusion that the complete scale 
and an abbreviation of it yield results which in terms of practicnl operation 
are almost identical. 

Summary and Conclusions 

Job rating data from three different plants wore B\ibiccted to the 
Wheriy-Doolittle selection tcelmiquc following the intcrcorrclation cl 
points awarded on each item. The three items yielding the highest R 
with the total point rating from eleven items were identified for each 
plant and a more detailed study of Plant A wan made. The following 
conclusions are supported; 

1. In each of the three plants, the "experience or learning time" item 
in the scale correlated highest with the total point rating arrived at from 
eleven items, the r’a being ,96, .93, and .86. 

2. The R for the combination of the three optimum scale items was 
found to be .98, .96, and .93 for plants A, B, and C, respectively. 

3. The items, "hazards” and "initiative” each appeared twico in the 
optimum three items in the plants studied. 

4. If the three item abbreviated scale were employed in Plant A, G2% 
of the jobs would remain m the same labor grade, 37.2% would be dis¬ 
placed one labor grade, and 0.8% would be displaced two labor grades. 

5. Such deviations aa exist between point ratings jus.signed by the 
original scale and by the abbreviated scale seem practically unimportant 
in terms of the magnitude of the range within any given labor grade, the 
flexibility of the plant wage schedule itself, and the probable unreliability 
of the ratings. 

6. A simplified scale consisting of three or four items would probably 
yield results that are practically identical with those ol)tained by n more 
complex system and would greatly reduce the time consumed by the 
rating activity, 

Hecmd June 30, W44. 



The Value of Aptitude Tests for Supervisory Workers in the 
Aircraft Engine and Propeller Industries 

John T. Shaman 

irtWajnspori Technical InatiluU, WUliaiMpOTl, Pennsylvania 

What the future holds for any company depends in a large measure on 
the ability, vision, and leadership of those in supervisory and executive 
positions. Management today is quite generally free from too great 
dependence on rule-of-thumb and the shrewd-guesa method of operating. 
Time consuming engineering efforts bring new designs into being, provide 
the tools and other facilities required for manufacture of an article. Yet 
the problems involved in the selection and training of men as supervisors 
have received inadequate attention. Generally industrial managers 
would not countenance such ‘thoughtless procedures in the handling of 
raw materials as are sometimes need in the selection and development of 
supervisors. This part of the investigation, however, ia confined to only 
one phase of this problem—that of reporting the results obtained in com¬ 
paring certain test scores with the job success of the supervisors studied. 

In their present state tests are not wholly adequate for predicting 
supervisory success. However, tests and rating scales do provide good 
and effective bases from which to start, or checks by which to gauge 
decisions. Supervisory and executive ability arise from the interaction 
of many different qualities and abilities, and no single test will measure 
entirely the many qualities and abilities involved. 

Method 

The' foremen, assistant foremen, set-up men, and group leaders as 
the case may be, were tested in small groups. These men were already 
working as supervisors when given the tests; hence, it is safe to assume 
that some form of natural selection had already taken place in most 
instances, 

The rating sheet illustrated here was used to secure a fairly objective 
rating on the job success of each supervisor tested. These ratings were 
made by superiors of the superviaoi’s studied. No more objective meas¬ 
ures of job success were available which would have been even relatively 
free from possible distortion by factors beyond the control of the super¬ 
visor. It is true, of course, that the study therefore is valid to the extent 
that the ratings represent a true picture of the job success of these indi- 
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vicluals. Relatively few ratings of “poor" were secured, probably due to 
the reluctance of superiors to so rate the men.. For tliis reason, many of 
the comparigona will be made between the “excellent’' and “aveinge" 
ratings, In other words, the percentage of excellent ratings will be used 
to determine the efficacy of the testa. Tlris procedure is justified for 
several reasons: 1. The amall proportion of poor ratings. 2. The prob¬ 
able operation of the bo called "halo elicct" among the average ratings. 
3. The excellent foreman is the one in whom we are most interested. 

Experience in giving these tests to groups of foremen iadicafceg that 
giving testa to groups of older employes is not too desirable a pracbice if it 
ia at all possible to teat all employes at the time they are hired. Since a 
man or woman applying for a position is usually willing to take a test, no 
problem of morale is involved because of the possibility of imminent 
decisions affecting the man's job in the near future. 


Eating Sliect Used in Rating Superviflors 
Date-- 

Name—- 

Position- 

Rated by----- 


1, Production: Consider whether work 
generally raovea through. tUia de¬ 
partment on Bchhdule, scrap and re¬ 
work, 

Above 

Average 

Good 

Average 

Uclow 

Averogc 

Poor 

2. Handling workcra: Consider disci¬ 
pline; extent to which this man. hna 
difficulty with his men; attitude of 
men toward company policies, etc. 

__1 

Above 

Average 

Good 

Average 

Below 

Average 

Poor 

d. Condition and maintenance of depart¬ 
ment; Good housekeeping, safety, 
condition of Dxaohinea. 

Above 

Average 

Good 

Average 

1_ 

Below 

Average 

Poor 

4. General: In general and from allaa- 
pects how would you rate. 

Above 

Average 

Good 

1_ 

Average 

1_ 

Below 

Average 

Poor 
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Table 1 prcseiitH a summary of rccommeDdcd minimurn critical scores 
and the percentage of improvement effected in the selection of foremen 
at the three mannfiicturing plants studied. 


Table 1 

Siuntnftry of llocommciulcci Minimum Critical BcortJs and Improvement Effcetcd 
in Bclcctujn of Foremen, All Plants 


Per Cent Improvement in 

Minimum Critical Score KYcollcnt Ilatings 


Teat 

By- 

corning 

{N=m) 

Ainoricnn 

Propeller 

(W=80) 

Saucer 

Ilealer 

(Af=24) 

Ly¬ 
coming 
(^^ = 99) 

Amcrienn 
Piopellcr 
(f/ = 89) 

Spencer 
Heater 
(^■ = 24) 

Otia Q,3. Test of 

Mental Ability beta, A 

33 

30 

32 

0 

6,4 

42 

Minnesota Poper 

Form Board, AA 

24 

34 

18 

8 

6,4 

21 

Bennett Test of 
Mccliniiical 
CoraprehenBior, AA 

30 

30 

26 

10 

8 

12 


Tile per cent improvement cHecled in the selection of roremen wag 
greatest at the Spencer Heater Plant and least at the American Propeller 
Plant with the results at the Lycoming Plant between the two, It ig 
significant, however, that an improvement in selection would be possible 
at each of the three plants with oil of the tests used. 

Table 2 summarizes the results with group leaders and job-setters at 
two of the plants. The third plant, Spencer Division, had no supervisors 
in this category. The percentage of improvement in selection, possible at 
both the plants represented in Table 2 is rather high. The results secured 

Table 2 

Summary of Rccommonded Minimum Critical Scorm and the Improvement Effected in 
Selection of Job-Settera and Group Leaders, All Plnntg 


Minimum Critical Per Cent Iraprovament 

Score in Excellent Ratinga 


Test 

Lycoming 

(H«26) 

American 

Propeller 

(iV=60) 

Lycoming 
(AT = 25) 

American 
Propeller 
{fV = 60) 

Otia Q.S. Teat of Mental 
Ability Beta, A 

34 

34 

17 

24 

Minnesota Paper 

Form Board, Roviaed, AA 

30 

24 

30 

12 

Bennett Teat of Mechanical 
Comprehenaion, AA 

30 

27 

47 

14 
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here with the group lenders in the American Proi>cller Corporation are 
much higher and more positive then those secured in the same company 
for foremen and reported in Table 1. 

As indicated in Table 3, the use of these throe tests would improve 
generally the selection of exceiloit aupervisors by 15 to 20 per cent. 

Table 3 


Avenge Improvement Effected in Selection of Excellent Snirerviaors,* 
AU Plnnta, All SvipetviaQra, N =» 297 


Teat 

Mean Iinprovomcnb in 
Selection ExcoUenb 
Snpv- bI Minimum 
Critical Scores 

Mean Improvomenb 
in Selection of 
Excellent Supv. 

fit Qi 

Bennett Test of Mechcinionl 
Comprehension, AA 

18% 

20% 

Otis Q.S. Teat of Mental 

Ability Beta, A 

10% 

17% 

Minnesota Paper 

Form Board, Revised, AA 

15% 

17% 


* Includes all supervisors; foromeo, ossiatanb foioman, group lenders, niid job setters. 


In Table 4 statistically significant correlations were secured on tlio Otis 
test in the Lycoming and Spencer Heater plants; on the Bemiett teat in 
the Lycoming and Spencer plants; and on tho Minnesota Paper Form 
Board in only the Lycoming plant. No statistically significant correla- 


Tablc 4 

Summary of Correlatioia between Job Rotinga end Test Reaulta, 
Foremen end Assistant Foremont, All Plants 



rw. 

Job Rating'with Raw Scores 

Tests 

Incoming 

Division 

(Ar=«09) 

Amoricaii 

Propeller 

Corporation 

(A=80) 

Spencer 
lien ter 
Division 

(y=24) 

Otis Q.S, Teat of 

Mental Ability 

Beta Teat, A 

.3ft ±.07 

.05 ± .0ft 

.60 ± .12 

Minnesota Paper 

Fom Board, 

Revised, AA 

.47 ± .07 

.08 ± .00 

.14 ± .04 

Bennett Test of 
Meclianioal Com- 
prelicnsion, AA 

,4Q5 ± .07 

.02 ± .00 

.65 ± .12 
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fcions were secured on any one of the three teats at the American Propeller 
Corporation Plant. 

Table 5 summarizes the correlations obtained on the group leaders and 
job Betters. The correlations with but one exception are significant. 
This one exception, an r of .37 ± .10, on the Bennett Teat with the 
American Propeller Corporation group leaders, approximates a significant 
correlation. Again, the results with this group of American Propeller 

Tablo 5 


Summary of Corrolatioiw botweea Job Ratings and Teat Eeaulta, 
Group Leadore ond Job Setters, All Plants 


Test 

rjji 

Job Rating with Teat Scores 

Incoming Atuorienn 

Division Propeller 

(17*25) (i7=90) 

Otia Q.S. Test of Mental 
Ability Beta A 

,4fi ± .14 

.54 ± .08 

Minnesota Paper Form 
Board, Revised, AA 

.sg ± .13 

.39 ± .00 

Bonnott Test Mechanical 
Comprehension, AA 

.73 ± .10 

.37 ± .10 

Table 6 

Mean Correlations between Job RatingB and Test Scores, All Supervisors, All Plants 

Test 

Mean Biserial r's 
Sunerviaors All Plants 
(i7=207) 

Moan Bisorial r’s 
Siipcrviaors All Plants 
Excep^t Ainer. Prop. 
Foremen * 
(17=208) 

Bennett Test of 
Mechanical Com¬ 
prehension, AA 

.45 ± .04 

.55 i .04 

Otis Q.S. Test of 

Mental Ability 

Beta, A 

.42 ± .04 

,61 ± .046 

Minnesota 

Paper Form Board, 
Revised, AA 

.33 =b .04 

.39 ± .05 


•The results secured with the Foremen, American Propfeller Corporation, did not 
coincide with those secured for the other four groups of supervisors including the Group 
Leaders from the same Company. Since these results were so much out of line, the 
author is taking tlic liberty of using a mean in this column which excludes this group. 
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Corporation supervisors arc much more positive ti\an the refluUa reported 
for the foremen of the same company and reported in Table 4. 

Averaging the r's secured ivith all supervisory grovipa yiekla the results 
shown in Table 6. The Bennett Test proved to be the most effeotive, the 
Otis Test next most efieefcive, and the Minnesota Tost tho least elective 
of the threCf 

ConclusioDfi 

1. Job-success on supervisary work was found to ho related positively 
and significantly to the test scores in these tlireo dissimilar industrial 
plants engaged in some phase of metal working. It is significant that 
each of these plants was entirely different from the others in the product 
manufactured and the character of work performed in the plant. It ia 
reasonable to conclude that supervisory work in these different plants 
has some factors^ skills, or aptitudes in common measured by the tests. 

2. The promotability of minor supervisors such as group leaders and 
job setters was found to be related positively and significantly with the 
test scores. 

3. The means obtained by the foremen and group leaders on the teats 
at Lycoming were below those obtained by workmen in the more skilled 
job categories in the factory. This is probably due to the effect of addi¬ 
tional experience and service of this group; that ia, years of experience 
on the job count heavily in recommendations for promotion. Further¬ 
more, the tendency of individuals ol superior ability to leave routine jobs 
would have a tendency to drain off many capable individuals before they 
had acquired a sufficient background of experience to be given the respon¬ 
sibility of superviaoiy work. 

4. It is algo logical that tests might well be utilized to survey a plant in 
order to determine whether its supervisory force measures up to recog¬ 
nized standards. In other words, the results indieate that there are levels 
bebw which the supervisory force of a plant should not fall. In this way, 
the proper testa would become one objective measure of a supervisory 
force, almost wholly dissociated from experience. 

U^ceived March i5,1944' 



Relationship between Interests and Abilities: A Study of the 
Strong Vocational Interest Blank and the Zyve 
Scientific Aptitude Test 

Louis Long 

Siwfieni Personnel Bureau, College of Ike Cily of New York 

If the vocational counselor is to do an adequate job he must constantly 
seek to discover relationships between the various techniques that he 
uses. The present study arose from speculation about the relationship 
between interests and ability as determined by two standardized tech¬ 
niques: Tl:e Strong Vocational Interest Blank (6) and the ZyvG Scientific 
Aptitude Test (8). Since most studies have reported a slight positive 
relationship between interests and abilities the question arose as to 
whether or not students who rated high on the scientific scales of the 
interest blank would do better on the Scientific Aptitude Test than stu¬ 
dents who rated low. Casual inspection of scores as they were discussed 
in interviews suggested that there wos a positive relationship and the 
results of this study confirm this impression. 

Such a relationship is certainly to be expected if the two techniques 
measure what they purport to measure. In this connection it should be 
mentioned that there is some question as to what the Scientific Aptitude 
Test measures (2). Only a slight relationship has been found between 
the scores on this test and college grades (1, 4). Nor does there seem to 
be any great amount of comraunality between the Scientific Aptitude 
Test and teats of general intelligence (1). If this test is measuring scien¬ 
tific aptitude it is to be expected that students who rate high on the Strong 
scales for engineers or physicists would make, on the average, higher scores 
on the Scientific Aptitude Teat than do students who rate low on the scales 
for these occupations. If the Scientific Aptitude Test is measuring scien¬ 
tific ability it can also be anticipated that there is a greater degree of rela¬ 
tionship between scores on this teat and high ratings on the "scientific 
scales” of the Strong questionnaire than between scores on this test and 
high ratings on the "uonscientific scales” of the Strong questionnaire. If 
such hypotheses are verified by an analysis of the scores on the two instru¬ 
ments it can then be inferred that the Scientific Aptitude Test is measuring 
some phase of ability that separates students who have interests similar 
to the scientist from those who do not have interests similar to the scien¬ 
tist. Consequently a more positive relationship between the Scientific 
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Aptitude Test and the scientific scale of tlic Strong than between the 
Scientific Aptitude Test and any other scale of the Strong would suggest 
that the two inatrumenta should be used to supplement each other in 
guidance work. 

Scores Used in the Statistical Analysis 

Strong has published norma not only for tlie individual occupatioua 
but also for groups of occupations (6). At the Student Personnel Bureau 
of the College of the City of New York it has become standard practice 
first to score the Strong blank against group occupational keys. If a 
break down of any group is desirable this can be done later, This pro¬ 
cedure greatly reduces the scoring time and on the basis of the reported 
correlations between the group occupational keys and the individual occu¬ 
pational keys this short cut seems justifiable (5, 6). The occupational 
groups and the occupations included in each arc listed in Table 1. Since 


Table 1 

List of Occupations Included in each of the Six OccupatioDal Groups 
of iho Strong Vocational Interest Blank . 


Group 1. Technical Non-mathemntios 
Artist 
Architect 
PaycKologiat 
Physician 
Dentist 


Group i. Business Detail 
Acoountanl 
Office Worker 
Putchaaing A.geut 
Banker 


Group 2. Technical Mathematics 
Mathematician 
Engineer' 

Chemist 

Physicist 

Group 3. Welfare 

Y. M. C. A. Physical Director 
Y. M. C. A. General Secretary 
Personnel Worker 
Social Science Teacher 
City Soliool Superintendent 
Minister 


Group 6. Business Contact 
Salra Manager 
Real Estate Salesman 
Life InsuraxicQ Salesman 

Group 6. Verbal 
Advertising Man 
Lawyer 
Author 
Journalist 


this study is primarily concerned with the Strong questionnaire as a. tool 
for use in guidance work, the statistical treatment will bo oriented around 
the letter ratings that Strong uses to indicate the degree of common inter¬ 
est between the individual and aparticular occupational group. The raw 
scores could have‘been. used, but it was thought that the results would be 
more typical if the letter ratings were employed. In several places 
throughout the report a division has been made between students obtain- 
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ing an A or B-|- rating and those obtaining a B, B —, C+, or C rating, 
This dichotomy is arbitrary, but such a division is often made in counsel¬ 
ing on tlie basis of Strong's suggestion that “a person should consider 
Bcriously those occupations in which he receives A or B+ ratings before 
entering some other occupation" (G). 

The total score of the Scientific Aptitude Test has been used through¬ 
out this roport. The scoring procedure recommended by Zyve (8) was 
followed. 


Subjects and Test Scores 

Scores on both the Strong Vocational Interest Blank and the Scientific 
Aptitude Test were available for 200 students of the College of the City 
of New York. Each student had sought advice from some staff member 
of the College’s Student Personnel Bureau and at the suggestion of the 
latter had taken both the Strong and the Zyve. Scores on the Thurstone 
A. C. E. Psychological Examination were also available for these students. 

Hcsults 

The average score on the Scientific Aptitude Test for each letter 
rating of the six occupational groups will be found in Table 2. For 
example, the average score on the Scientific Aptitude Tost for students 
obtaining an A rating on the Strong Technical Non-mathematics group 


Table 2 

Eelationship between Soorcs on Zyve Soionlifio Aptitude Test and Ratings 
on Strong Vocational Interest Blank 


Occupationnl 
Groups of 

Strong 

Average Score on Zyve Test According to Categories of Strong 

A 

D+ 

D 

B- 

c-i- 

C 

Tech. Non-Mfith. 


WM 

03,6 

03.0 

100,0 

95,0'“ 

Tech. MiiLh. 


■uiiVw 

88.2 

90,8 

01.0 

87.4 

Welfare 



08.9 

105.2 

92,0 

119.8* 

Bufiinees Detail 


103.4 

03.0 

07.2 

07.0 

106.6 

Business Contact 


82.4 

04,8 

09.7 

105.2 

107.6 

Verbal 


97.6 

100.0 

101.9 

104,9 

116.4'“ 


* A.vcrngc based on less than 10 coses. 


was 107.4. A positive trend will be noted in the case of the Technical 
Non-mathematics and Technical Mathematics groups; a negative trend 
is found in the case of the Business Contact and Verbal groups; but no 
definite trend is apparent in the two remaining groups; Welfare and Busi¬ 
ness Detail. To form some idea of the significance of these trends the six 
steps on the Strong scale were consolidated into two steps: ratings of A and 
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Table 3 


Reliability of the Difference between Average Scores on Zyvo Scientific Aptitude Test for 
High and Low Ratings on Strong Vocationol Interest Blank 


Occupational 
Groups of 

Strong 

Subjects with Ratings of Subjects willi Ratings of 
B-i- or more on Strong B or less on Strong 

/^-valuo 
of the 
Difference 
between 
Averages 

V 

Averngo 
Score on 
Zyvo Teat 

V 

Averago 
Score on 
Zyve Teat 

Tech. Non-math. 

no 

104.2 


93.6 

mm 

Tech. Math, 

97 

109,9 

103 

80.G 


Welfare 

108 

98.7 

mm 

100.4 


Business Detail 

24 

94.5 


100,1 

>,30 

Business Contact 

34 

85.4 

mM 



Verbal 

84 

90.0 

no 

■ iH 



B -f and ratings of B or less. The average score on the Scientific Aptitude 
Teat for students falling into these two oategorics will bo found in Table 3. 
The reliability of the difference between the averngeg was dctormined by 
using Student’s i-Teat (3). The P-values presented in Table 3 indicate 
that in three of the six cases such a> difference between the averages would 
be expected to occur by chance less than five times in 100. Using this 
as a ci'iterion of a significant difference we can say that the following trend 
is significant: students scoring high on the Scientific Aptitude Test rate 
higher on the Strong Technical Non-mathematics and Technical Mathe¬ 
matics groups, but lower on the Business Contact group than do those 
scoring low on the Scientific Aptitude Test. 

Table 4 

Bi-seri&l Coirelationa between Scores on the Scientific Aptitude Test and Ratings on 
Strong Vocational Interest Blank (B + or more versus 'B or leas) 


Occupational Groups 

Bi'Serial 

of Strang 

Correlation 

Tfioh. Non-math. 

0.2G 

Tech. Moth. 

0.60 

Welfare 

-0.04 

Business Detail 

-0.12 

Business Contact 

-0,87 

Verbal 

-0,14 


If the Scientific Aptitude Teat ia positively related to any occupational 
group of the Strong scale it would be expected that the Tecluiical Mathe- 
matics group would be the moat likely one to show thia relationship. The 
second most likely group would be the Technical Non-mathematieg, Pos¬ 
itive relationships wei'e found in both instancea. The extent of the 
relationship ia, however, greater for the Technical Mathematics group 
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since tlie P-viiluc in one case is 0.001 and only 0.01 in the other. This 
difference can also be Ijrought out by calculating a bi-serial correlation 
between scores on the Seiontific Aptitude Test and the categories of B + 
or more versiiH II or less on the Strong scale, When this is done a bi-serial 
r of 0.50 is obtiiinnd for tlio Technical Mathematics group and one of 0.26 
for the Tecimical Non-inatlunniifcica. (The correlation,s for the other 
occupational Rroups ^vill be found iu Table 4.) 

The negative or cliuncc reliitionahip between the ratings on tho four 
other occupational group.s and scores on the Scientific Aptitude Test 
Btrengtliens tlie above finding since there ia no reason to expect a direct 
correapondcncc between tho two techniques in these cases. 

In an effort to determine whcLlicr the students with high scorea on the 
Technical Mathematics group of the Strong scale were just superior 
students or "high aeorora" the same analysis was applied to the total score 
made on the Tlmvstone A. C. E. Psychological Examination. Of the 
200 students in the i)raceding comparisons, 95 took the 1938,1939, or 1940 
edition of tho Thurstoue test. The scores on the 1938 and 1940 editions 
wore converted into 1939 equivalent scores by using the table supplied by 
Thurstonc (7). Tlio average scores on tho Thurstone test for students 
obtaining an A, li+, B, B—, CH-, or C rating for the six occupational 
groups of tho Strong scale will bo found in Table 5. The absence of 

Table 5 


Holntionflhip between Scores on Thiiratouo A. C. E. Psychological Exa:niimtion (1039) 
and Ilaliiigs on Strong VoentionAi Interest Blank 


Ocoiipnbional 
Groups of 

Strong 

Avorngo Score on Thurstone According to Categories of Strong 

A 

B+ 

B 

B- 

C-f 

C 

Tecli. Non-math, 

124,0 

111.4* 

124.7 

114.3 

135.3* 

132.0* 

Tech. Math, 

121.3 

120.8 

120.0 

121.8 

132.9* 

120.6* 

"Welfarfl 

125,0 

127.4 

118.0 

127.5* 


116.5* 

Business Detail 

llG.l* 

110.7* 

126.1 

118.7 

128.1 

124.4 

Business Contact 

145,0* 

100.8* 

122.0 

127.1 

121.1 

119.3 

Verbal 

120.8 

121.7 

120.0 

120.6 

111.7* 

116,0* 


* Average baaed on Ics.h than 10 cnacs. 


definite relationships between scores on the Strong scale and scores on the 
Thurstone test is clearly evident, except in tho case of the Verbal group. 
When the average Tluirstonc score for students rating high on the Strong 
scales was compared with the average Thurstonc score for students rating 
low on the Strong scalc.s a significant difference was found only in the case 
of the Verbal group (Table 6). It seems logical to expect a relationship 
between the ratings on the Verbal group of the Strong scale and the scorea 
on the Thurstone test, since the latter ia so highly verbal, 
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Table 6 


Reliability of the Difference befc-wecu AveiftBQ Sconw onTlmretono A. C. R, Psychological 
Exaraination (1939) for High and Low Ratings on Strong Vocational Interest Clank 


Occupational 
Groups of 

Strong 

Subjeeba with Ratings of Subjects uith Ratings of 
B-(- or more on Strong D or loss on Strong 

P-vftlue 
of the 
Difference 
between 
Averages 

N 

Average 
Score on 
Thuralono 

N 

Average 

Score on 
Tlmratono 

Tech. Non-math, 


MSm 


12-1.8 


Tech. Math, 



60 

122.8 


Welfare 


BPB 

40 



Dueiness Detail 


BBsfl 

85 



Business Contact 



80 

122.0 

>.60 

Verbal 


Bi 

65 

119,3 

<,05 


Summary 

TJie leJationship between interests and acientific ability as measured 
by the Strong Vocational Blank and the Zyve Scientific Aptitude Test 
was investigated. Use of the occupational group scales on the Strong 
disclosed that in three oi six groups there was a reliable difference between 
the average score on the Scientific Aptitude Test for students rating high 
on the interest questionnaire and for those rating low. Tlio findings indi¬ 
cate that students scoring high on the Zyvo Teat rate higher on the Strong 
Technical Non-mathematics and Tcohnicai Mathematics groups, but 
lower on the Business Contact group than do those scoring low on the 
Zy ve Teat. In order to rule out the possibility that tlieso results were due 
to the selection of superior students the same analysis was applied whon 
scores on the Thurstone A. 0. E. Psychological Examination (1939) were 
substituted for scores on the Zyve Scientific Aptitude Test. No definite 
relationship between scores on the Thurstone test and ratings on the 
Strong scales was found except in the case of the Verbal group. 

The results indicate that the Zyve Scientific Aptitude Test is measur¬ 
ing some phase of ability that separates students having interests similar 
to those found among the occupational groups included in the Technical 
Mathematics and the Technical Non-mathematiofl groups of the Strong 
from those students who do not have interests similar to those found in the 
above oGGUpational groups. From the common sense point of view the 
agreement between the two measurements is to be expected. The Zyve 
Test deals largely with problems involving mathematics and principles of 
physics. Even when the items are intended to measure general abilities 
(such ns reasoning, generalizing, and suspending j udgment) the content of 
the item ia usually drawn from the physical ecience field. Sitnilarly, in- 
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flpectiou of tiu! keys of tlic Strong Technical Mathematics and Technical 
Non-innthematics scales reveals that the llcmH dealing with scientific and 
tficlinicftl subjects or activities are heavily weighted. Consequently some 
agreement between the two inKtriimeiits would be expected. The extent 
of this agreement, ho^rever, is fur from perfect. For example, there is not 
enough agreement to permit tlic prediction of a score on the Zyve Scien¬ 
tific Aptitud(! Test from a rating on the Technical Mathematics scale of 
the Strong. It i.s, therefore, concluded that the use of both of these 
instruments in counseling in better procedure than the use of either one or 
the other if tlic capacity of n student to do work in engincDring or science 
is under consideration. 

Rsmtd May l(), lOU. 
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Tlie Measured Interests oi Marine Corps Women Reservists * 

Milton E. Hahn, Captain, USMCR, ** and Cornelia T. ■Williams, 
Major, USMCWR. 

Jleadquarlers, V. S. Marine Corps, IVnshsnji/on, /). C. 

A fundamental purpose of the whole Marine Corpti' syatom of person¬ 
nel classification is the assignment of each individual to the typo of mili¬ 
tary duty where he or she can soonest and most efficicLitly serve the 
Marine Corps. In the accomplishment of this purpose, and as ,a pre¬ 
liminary to military assignment, each recruit is tested, interviewed, and 
given an opportunity to express his "choice of ihity”; anti all of the in¬ 
formation thus obtained is recorded on his Qualification Card, Form 940, 
In this way, his basic aptitudes, his education and work oxperience, hia 
special skills, and at least a crude indication of his interests become nvail- 
ablo as a basis for determining the most appropriate military assignment 
for each Marine. 

Civilian occupational backgrounds of women enlisting in the Marine 
Corps supplied extremely useful data for proper assignment to militaiy 
duty, but were at times misleading, or inadequate. For example, many 
school teachers and clerical workers joined the Marine Corps lo escape 
fiom tbeii civilian jobs. Many of the younger women joining the Corps 
had little, if any, previous work experience, and therefore, possessed no 
specific occupational skills. Others hod considerable experience and had 
even developed a high degree of skill, but in a specialty so unrelated to 
any of the jobs open to ■vvomoi in the Marine Corp.s, that this experience 
was of little help in determining appropriate military aBsignineuta. Fi¬ 
nally, many of the occupational specialties performed by women Re¬ 
servists in the Marine Corps could not be significantly differentiated by 
available estimates or measures of basic aptitudes, 

These facts made it obvious that in many instances a crucial factor in 
determining a military assignment would have to be a woman's interest in 
doing a particular type of work. This was sspecially true for women who 

* This report is pwt of & Btucly mado by ti\e authots for tlio CloBsificfttion Division, 
Detail Branch, Poraonnel Department, USMC, Headquarters, Wnaliington, D. C. Tlie 
opievioM or esaortion^ oontainftd in tliis mtitle aTalVvo ptivalc oncB of tiro outhoTft ftod 
are not to be construed as olRcinl or reflecting the views of tlie Navy Department or the 
naval service at large, 

♦*Dr, M. E. Hahn is now Director of the ftiychologioftl Services Center at Syracuse 
Univeraity, Syracuse, N. Y. 
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had no special occupational skilla, and for women who possessed occupa¬ 
tional skills which could not be used directly in military duties. The need 
for a valid estimate of interests was equally great in selecting women for 
assignment to certain military jobs in which large numbers of women were 
needed but for which special training lind to be arranged because so few 
women entering the service had had relevant previous experience. 

A search was necessary, therefore, for tools and techniques which could 
bo utilized to bring about tlie assignment of women in tho Marine Corps 
to duties for which they would not only possess the necessary minimum 
aptitudes and skills but in which they would also be interested and satis¬ 
fied, and therefore, able to perform with greater efficiency. 

In the early stages of the Marine Corps Women's Reserve program the 
only technique used for determining the interests of individuals was the 
interview. For most of the enlisted women this amounted to little more 
than one or two direct questions about “choice of duty” inserted at the 
end of the olossificatiou interview. A minority of each recruit class (those 
being considered for n few special types of military assignment) were 
rointerviewed to obtain a more precise description of their previous ex- 
pci'ienco or to permit a dearer expression of their interests. Although the 
information relative to interests derived from interviews was helpful in 
making assignments to duty in the Marine Corps', a year of experience 
demonstrated the need for supplementary screening devices. Interviews, 
if they were to yield significant information on interests, were time- 
consuming; interviewers were variable in the reliability and validity of 
their judgment.^; and the claimed interests of the women, expressed 
merely ns a preference for a specific military assignment, often had little 
or no validity as an indication of real interest in actual work activities. 

A study of the situation was authorized by the Director of Personnel, 
Headquarters, United States Marine Corps, in March, 1944. The study 
included three major aspects: (1) the job satisfaction of femaie personnel 
in selected military occupations; (2) the measured interests of women in 
military occupations; and (3) a comparison of claimed and measured 
interests of women performing military duties in the Marine Corps. This 
report is concerned with the second aspect of the study, the measured 
interests of women now performing certain military duties. 

It was decided to select for study a sample of women Reservists cur¬ 
rently assigned to several widely different types of military duty. Mat¬ 
ters of expediency limited the selection to those most readily available 
for testing. All of the women included in the study here reported were on 
duty either at Marine Corps Headquarters, Washington, D. C., or at the 
Marine Corps Air Station, CheiTy Point, North Carolina. 

Descriptive data on 667 enlisted women Reservists in the study arc 
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presented in Table 1.^ (Three groups of women ofRcerg were also in¬ 
cluded in the study of measured intercsfa biit are not included in this 
table,) No marlced difTerencea arc noted among groups in age or years of 
education. The mean ago of motor vehicle operators is somewhat higher 
than the average age for the total group—27.4 vs. 24.6 years. The mean 
age for aviation machinist mates is somewhat lower than the mean age 
for the total enlisted group—22.6 va. 24.0 years. Otherwise, the groups 
are relatively liomogeneoua in ao far os age and years of education are 

concerned. 

The Army General Classification Teat, Forms c or d, and the Army 
Mechanical Aptitude Test, Form 3, are administered to all women Ue- 
Berviata. Norms for Army men are used. The minimum education 
requirement for enlistment in the Marine Corps Women’s Reserve, com¬ 
pletion of the twelfth grade or the equivalent, has resulted in a mean 
standard scale score of approximately 111 for enlisted women in the 
GOT. The moan GCT score for the enlisted sample discussed here is 
114,o' somewhat above the mean of 102 obtained by enlisted men. 

On' the GCT, synthetic training devices instructors, stenographers, 
and the composite group of.raisccllaneous occupations labelled “Other’' 
were above the group mean with respective means of 121.0, 117.8, and 
119,2; standard deviations for these groups were similar to the one for 

the total group. „ . x tv 

The only sub-group witii a mean appreciably lower than that lor the 

total group was Cooks and Bakers (mean 102.6). Thia group was also 

the most variable in the GCT scores. 

Scores on the Army Mechanical Aptitude Test Form 3 showed no 
significant differences between means for the military occupational sub¬ 
groups and the mean for the total sample except for aviation machinist 

mates The ^ for the total mean and that for the aviation machinist 

ffn 

mate sub-group was 3.93. 

Civilian occupational backgrounds of these enlisted women lyere het¬ 
erogeneous. The IGl women Reservists assigned to duty as clerk-typista, 
lor example, came from 25 different civilian occupation^ 

Two interest testa or inventories were considered, The Slrono Voca- 
iional Merest Blank, although it is the best validated and most widely 
used interest inventory, was impracticable from the stondpomts of scoring 
costs and complexity of interpretation. The Kuder Preference Record, 

‘ Discropincica in Uic immlicr of cMcs toported between Tiblo 1 md Table 2 are 

cmiaecl bv certftin records beine unftvailftblc for ViinouB renaons, 

>ThB Preference Record Jorm RB. Scicooe Research AssoemtcB, Chkcago, 

IllinoiB. 
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although it is a comparatively new instrument, offered advantages in the 
simplicity of its administration, scoring, and interpretation. The Kuder 
Preference Record, therefore, was used to measure interests. 

The Kuder Preference Rec&rd contains nine scales which are purported 
to measure intensity of interest in nine broad areas of occupational ac¬ 
tivity. These nine areas ate; (1) mechanical, (2) computational, (3) 
scientific, (4) persuasive, (5) artistic, (0) literary, (7) musical, (8) social 
service, and (9) clerical.® 

This test is taken by punching with a stylus two of six possible choices 
for each item. Scoring is extremely simple. Single unit weights are used 
for scoring the items. The nine scores on the Preference Hecord yield an 
interest pattern or profile for the respondent. Adequate interest profile 
norms are not available for civilian occupational groups. 

The test was standardized with the assumption that significant sex 
differences did not exist. The validity of this as.sumptioii can be tested 
by a comparison between the original norma, based upon a mixed group 

Table 2 

Means and Standard Deviations tor 701 VSMCWH on the Nine Scales 
of the Kuder Preference Record, Fonn BB (fV = B16) 

Mcana Standard Dovintions 


Kuder Scales 


Kuder 

USMCWR Norms * 


USMCWR 


Kuder 
NormB * 



* Means and standard deviations for the Kuder Norm group were estimated from 
percentile norms on the Profile sheet based upon the assumption tliat distributions were 
normal. 


of college men and women, and the average scores of the Marine Corps 
Women Reservists. These comparisons are presented in Table 2. Al¬ 
though data on Kuder's original standardization group were not available 
for proper tests of the significance of differences between means, tentative 

■ Manual for the Kuder Pr^erence Record, Science Research Associates, Cliicngo, 
Illinois. Unfortunately, the present manual {June 194i) for the Preforenoe Record is 
inaccurate and misleading. Those interested in the inventory ate referred to the bib¬ 
liography nt tlie end of this report. 
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tests were made based on tlio assumption that distributions for Kuder^s 
norm group were normal. These data are presented in Table 3. The 
null hypothesis was nob refuted. 


Table 3 

Decile Norms for 701 Adult Womon, USMGWR, on the Nine Scalea 
of tlio Kuder Frefenneo Record 


Raw Score 


Deciles 


Kuder Scales 

10 

20 

30 

40 

60 

00 

70 

80 

90 

100 

Range 

Mechanical 

33 

40 

40 

52 

57 

63 

71 

78 

86 

109 

21-116 

Computational 

14 

IB 

22 

20 

29 

32 

35 

39 

47 

05 


Sclontiiic 

30 

43 

48 

53 

67 

61 

05 

71 

70 

06 

26-102 

Perauaaive 

41 

47 

51 

55 

60 

64 

60 

74 

81 

108 

29-112 

Artistic 

34 

41 

46 

60 

64 

68 

63 

69 

70 

95 

21- 98 

Literary 

34 

40 

44 

40 

63 

67 

02 

67 

75 

93 

23- 96 

Musical 

10 

14 

17 

20 

23 

26 

20 

32 

30 

46 

3- 71 

Social Service 

53 

00 

07 

73 

78 

83 

80 

95 

102 

120 

30-122 

Clerical 

31 

30 

41 

46 

61 

66 

60 

66 

73 

07 



Table 3 contains decile raw score norms for the 791 women who com¬ 
pleted tlie Preference Record. Intercorrelations were computed for the 
nine scales included in the inventory. These data are presented in Table 
4. With five exceptions—mechanical vs. scientific, mechanical vs. lite¬ 
rary, mechanical vs. clerical, computational vs. clerical, and artistic vs. 
social service—there is little evidence that correlations among the scales 
depart markedly from zero in so far ns this sample is concerned. 

Military occupational sub-samples of women Reservists in the Marine 
Corps were compared statistically. These sub-samples were: Officer, 
line; Officer, staff; Officer, technical specialty; Aviation Machinist Mate; 
Assembly and Repair (Aviation); Motor Vehicle Operator; Cooks and 
Bakers; Synthetic Training Device Instructors; Stenographer; Clerk- 
typist; Clerk, general; Duty Non-Commissioned Officer; and Otlier.^ 

Means and standard deviations for these military occupational groups 
are presented in Tables 5 and 6 respectively. 

Time did not permit a comparison of the mean of each occupational 
group with the mean for every other occupational group. The mean for 
each occupational group was, however, compared with the mean for the 
total sample. The Preference Record did differentiate most of tlie occu- 

* Tlie "Otlipr" group censkted of 122 cases in military occupations the samples for 
which wero too amall or the occupation of too little importance to warrant separate 
treatment, Diatributiuns for fchia occupationiJ composite closely approximated those 
for the total sample. 
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Table 5 

Mean Scores for 12 Occupational Groups of Woinen, MCWH, on the Nine Scales of the Kuder Preference Eecorj 
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pdtionfil groups from gGnsro-Iity on one or moro scnlcs despite the fact tliat 
data for the sub-group were not removed from the generality for the 
comparisons. Occupational groups not differentiated Bignificautly from 
generality by at least one of the nine scales were officer—staff, cooks and 
bakers, and synthetic training devices instructors. Table 7 presents “/’s” 
for differences between means for each occupational sub-group and the 
total sample for each of the nine interest areas. 

Table 7 is of particular interest because it illustrates a phenomenon 
which has not received much attention in the literature ooncerned with 
the measurement of interest—"rejection” or “aversion” scores. The 
topic is not particularly germane to this report, but attention is called 
to the fact that occupational groups are as clearly differentiated on interest 
scales by their "rejection” scores as they are by their "acceptance” or 
"interest in” scores. Bingham’s statement that a C grade obtained on an 
occupational key of the Strong Vocational Interest Blank means "No” 
may need change to "No, for that occupation; yes, for some others.” ® 

The rejection of items positively "weighted for the clerical scale may be 
as important to the measurement of an interest in the duties of an Aviation 
assembly and repair worker as the acc&ptance of items positively weighted 
for the mechanical scale. 

The preliminary aspect of this investigation was a study of job satis¬ 
faction which indicated satisfied and dissatisfied groups of workers. 
Scores on the Preference Record scales were separated for these satisfied 
and dissatisfied groups. Scores on tho inventory for these two groups 
showed marked differences between them on one or more interest scales. 
Tables 8 and 9 present these data for three groups of clerical workers. 
These tables make it obvious that occupational norm groups for a test of 
interests should be composed only of those who are satisfied with their 
jobs. Groups so constituted in this study have interest profiles much 
more clearly differentiated from the total standardization groups than 
sub-samples containing a large proportion of individuals disinterested in 
or dissatisfied with the type of Avork they are doing. 

Conclusions 

Although the major purpose of this report is to present norms, and 
statistics related to these norma, certain coneluBions of general interest 
are presented here. 

'• Bingham, "W. V,, AplUudes and aptitude testing, Harpers, 1037, Appendix, Section 
IX, p. 356, 

* None of the other mili tary occupationnl Bub-Bamplea contained enough dissatisBed 
workers to make an analysis of this sort possible or necessary. 
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1. Certain occupational sub-samples of women Reservists in the 
United States Marine Corps can be differentiated by scores on various 
scales of the Kuder Preference Record. 

2. In the case of three sub-groups of clerical workers—stenographers, 
clerk-typists, and clerks, general—certain scales on the Preference Record 
differentiate satisfied from dissatisfied workers, In each of these three 
sub-groups, the satisfied workers are more clearly differentiated from the 
total group of 791 than are sub-groups containing both satisfied and 
dissatisfied clerical workers. 

3. "Rejection" (low or negative) scores on certain scales differentiate 
occupational groups from the generality aa markedly as do the '^accept¬ 
ance" (liigh or positive) scores. 

4. Group differentiation is a matter of patterns or profiles which are 
characterized by both "acceptance" and "rejection" scores. 

5. Comparison of individual profiles with occupational sub-sample 
profiles permits a surprisingly good interest screen for use in the assign¬ 
ment of women Reservists to military duty. 

Received July 5, Id^. 
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Personality Patterns of Adolescent Girls: I. Girls Who Show 
Improvement in IQ * 

Dora F. Capwell 

Trainee Acceptance Center, PuhUc Schools, Pa. 

The resewch described in this report was designed to discover what 
differences there are between those adolescent girls whose IQ's change 
significantly upon retest and those whose IQ’s show only alight changes. 
Its purpose, therefore, is to throw additional light upon the problems of 
Individual, clinical diagnosis, which inevitably invoLvea or at least implies 
prediction of a future level of performance. The determination of what 
factors within the individual affect teat scores is a more narrowly defined 
problem than the one of mere constancy of IQ, measured in terms of group 
data, and is, of course, significantly related to accuracy of diagnosis, which 
is preliminary to the planning of effective educational and social treatment. 

Literally hundreds of studies have been reported which contain retest 
data from intelligence tests. They have been reviewed and summarized 
by Baldwin (2,3), Burks (6), Foron (9,10), Nerazek (24), and Thorndike 
(31). Although the studies have dealt with all age levels, various time 
intervals, several different testa, and a wide variety of testing conditions, 
the coefficients of correlation between teat and retest have ranged from 
.63 to .95, most groups showing correlations of .84 or better. Treated by 
the correlation technique, the data consistently showed high positive cor¬ 
relation between test and retest, and hence the authors assumed that they 
demonstrate the relative constancy of the IQ. 

The studies which are of special interest here are the ones which at¬ 
tempt to determine the causes of change in level of test performance in 
those cases which showed variability of IQ. These may be divided into 

■•ThD writer is indebted to the Department of Paychology, Univeraity of Pennayl- 
vania, and particularly Drs, Malcolm G. Preaton, Francis W. Irwin, and Milos Muiphy, 
who served as researcli advisers in tho final stages of the work, for advice and confltruotivo 
critloism. 

Gratitude is due to the Bureau of Psychological Services, State of Minnesota, which 
sponsored the study. Valuable assistonco was given by the late Dr. Fred Kuhlmann and 
his successor, Dr, Stuart Cook, The staff of Uie State School lor Girls ot Sauk Centre, 
Minnesota, and the Sauk Centre Public Schools gave their wholehearted cooperation. 

Dr, Starke R, Hathaway, University of Miimeaota, made the Multiphaaio Personality 
Inventory available to the writer beforo its publication and woa helpful throughout the 
period of collecting data. 
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three groups: studies which include special analysis of the extreme cases in 
the distribution of IQ changes (7, 13; 20, 22, 25, 32), studies mode on 
selected groups of problem children (5, 12), and studies of the effect of 
specific factors, such as attitude, emotion, and psychopathic personality 
(5, 11, 10, 19, 23, 27, 28). All of these studies have been characterized 
by a lack of objective data aside from the intelligence test scores. Most 
frequently causes of IQ variability have been assigned by surveying the 
history, considering the events which liave taken place between testa, and 
making a highly subjective judgment. No study reported convincing 
evidence that personality factors are functionally associated with changes 
in IQ on retest, although many authors drew that conclusion from what is 
here considered insufficient evidence. 

The present study attempts to present a more objective description of 
the individuals studied by utilizing scores on a variety of tests, analyzing 
items of possible significance in the history, and also analyzing the record 
of personal-social events which occun'ed between examinations. The use 
of both a normal group and a definitely maladjusted group permits a more 
thorough exploration of the significance of a wide variety of concomitant 
factors. Although the study was planned to investigate factors related to 
IQ variability, the results led to a study of those who.se IQ improved as 
compared with those whose IQ remained relatively constant. Three 
major questions will be asked of the data. 

(1) Are there significant differences of personality and experiential 
background'between those adolescent girls whose IQ shows significant 
improvement and those whose IQ changes only slightly? 

(2) Is significant improvement in the IQ of adolescent girls related 
to improvement in the adjustment pattern of the total personality? 

(3) Are the relationships which ate investigated first in a delinquent, 
institutionalized, adolescent, female group demonstrable in a non-delin¬ 
quent, adolescent, female group in the community? 

Procedure 

Subjects. The subjects were 101 delinquent girls and 85 non-delin- 
quont girls who were between ages 12 and 18 and whose IQ on the first test 
was not less than 60. The delinquents were consecutive admissions to 
the Minnesota State School for Girls, beginning in September, 1941. 
The non-delinquents were in the consolidated public school at Sauk Cen¬ 
tre, Minnesota, and were chosen from grades which would match the 
usual grade distribu Lion of girls entering the State School. Tiie principal 
selected every other girl from the grade lists until the necessary number 
was obtained. The groups were roughly equated for urban-rural back¬ 
grounds. Both schools have a population which is about two-thirds 
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urban and one-third rural, when their places of residence are classified 
according to the TJ. S. Census criterion of urban and rural. 

The method of selection resulted in two groups of the following descrip¬ 
tion. The delinquents ranged in age from 13 to 19 with a median age of 
16. The non-delinquenta ranged from 12 to 18 with a median ago of 15. 
The alight difference in age range is a reflection of the fact that the delin> 
quents show more school retardation, ao that their average age for each 
grade is a little older. The median grade placement of tho delinquents 
was 9th grade; 86% were in grades 7 to 10, inclusive, 12% were above 10th 
grade, and 2% were below 7th grade. The median grade placement of 
the non-delinquents was also 9th grade, -mth 94% in grades 7 to 10, 
inclusive, and 6% above 10th grade. 

Collection of Data. The data consist of test scores obtained on two 
psychological examinations, items of classification from the personal- 
social history, and items of classification related to progress between 
exammations. The delinquents were examined the first time within their 
initial two weeks at the School, and the second examination was given 
from 6 to 15 months later. The non-delinquents were examined the first 
time in the fall of 1941 and were re-examined from 4 to 13 months later. 
The tests given at both examinations were the Kuhlmann Teats of Mental 
Development (18), the Minnesota Multiphasic Personality Inventory 
(14), the Washburne Social Adjustment Inventory (33), and the Pressey 
Interest-Attitude Test (26). Three testa which each subject took only 
once were the Terman-Miles Test of Masculinity-Femininity (30), the 
Vineland Social Maturity Scale (8), and the Stanford Achievement Teat 
(17). Three testing sessions were used to complete the entire battery for 
each examination. All of the tests were administered by the writer with 
the exception of the delinquents' Stanford-Achievement Tests, which are 
given routinely by the school principal at the State School. 

From the personal-social history of the delinquents tabulations were 
made of the occupation and education of parents, national and racial 
background, language spoken in home, work experience, length of time 
out of school, type of delinquency, and other social problems within the 
family. Information on the non-delinquents was obtained by personal 
interviews and from the school records regarding occupation and educa¬ 
tion of parents, language spoken in the home, work experience, and any 
social problems in the family. For the delinquents there were also Home 
Ratings made by the State School field workers on a large proportion of 
tho cases. 

For the interval between testa the record of the delinquent cases 
included health status, school grades, d^cipline reports, and ratings of 
work habits and general,conduct made by the housemother, work super- 
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visor, and supervisor of home^life. For the non-delinquenta there was a 
record of health history and school grades. The latter were recorded 
from the principal’s records, and the student’s report on health was 
checked by records in the office of the school nurse. 

Results 

InielUtjence Test Results. The Kuhimann Teats of Mental Develop¬ 
ment were used aa the measure of intelligence, and, hence, the main 
characteristics of these tests should be kept in mind when examining the 
results. When applied at the age levels used in this study, the scale 
consists of sixteen tests, all of which are timed, and all of which are scored 
fit successively higher levels, depending upon the amount accomplished 
in a given time interval, usually two minutes. Five of the tests demand 
the use of spatial relatione and of spatial imagination, The others are 
more strictly verbal. Each teat is given- a time score and an accuracy 
score as well as a mental age score. Sixteen is the highest chronological 
age denominator used in computing IQ’s. The results of these groups 
are summarized in Table 1. 


Table 1 

Kuhimann Teats of Mental Davelopment 




DeUnqaeAta 


Non-Delinquents 



Mean IQ 

S.D. 

am 

Mean IQ 

S.D. 

am 

1st Teat 


17.10 

1.70 

■n 

17.69 

1.90 

2nd Test 

95,fl5 

10.62 

1.G5 


20,50 

2.22 


The non-delinquents are significantly brighter than the delinquents on. 
both tests. V/(rD on the first test is 5.70, and on the second one it is 5,46. 
Despite the difference in mental levd, each group showed about the same 
amount of shift in IQ on the second test. The average amount of change 
was an increase of 8 points for the delinquent group and 10 points for the 
non-delinquent group. 

The coefficient of reliability was computed with the test-retest scores 
for each group. Product moment correlations also were computed to 
determine the relationship of IQ changes to time interval, change in speed 
score, change in accuracy score, and level of first IQ (Table 2). The 
time interval between testa and the change in accuracy score had a negli¬ 
gible relationship to the changes in IQ, but there was a marked relation¬ 
ship between speed score and changes in IQ. The reliability coefficient is 
high enough to be considered satisfactory for a teat used for individual 
diagnosis. It is of interest in passing that these are the first reliability 







216 


Dora V'. Ca'pwell 


coefficients reported on the Kuhlmann Tests of Mental Development.^ 
The correlation between IQ change and level of first IQ is so low that no 
relationship between them is indicated, implying tliat the distribution of 
changes at various IQ levels is not affected by the IQ level itself, 

Table 2 


Product-Moment Corrolations Baaed on the ReflulUs from the Kuhlmann 

Teats of Mental Development 


Delinquents 

Non-Delinquents 

TeaHeteat reliability 

,90 ±.01 

.88 ± ,01 

IQ change and timo interval 

-.02 ±.06 

,06 ± .07 

IQ change and change in accuracy score 

.18 ± .06 

.16 ± ,07 

IQ change and change in speed score 

.44 ± .05 

.41 ± .06 

IQ change and level of first IQ 

.08 ± .06 

.15 ± .07 


We find that the IQ's of approximately 36% or 36 of the 101 delin¬ 
quents changed more than 10 points, and 48% or 41 of the 85 non- 
delinquents changed snore then 10 points,* Inasmuch as the standard 
error of a score is 5.4 for the delinquents and 6.7 for the noa-delinquenta, a 
change of more than 10 points would occur by chance only 5 times in 100 
for the delinquents and 10 times in 100 for the non-delinquents. A 
change of more than 10 points, then, with this group may be considered a 
significant change. In presenting the results of the other tests, we shall 
divide each major group into two subgroups—those whose IQ changed 
10 points or less, called the constant group, and those whoso IQ changed 
more than 10 points. These latter groups should be thought of as vari¬ 
able groups in contrast to the constant ones, but since only one delinquent 
and one non-delinquent had IQ’s which regressed more than 10 points, 
the I'emainder really improved, and the groups are essentially groups 
which showed significant improvement in IQ as against those whose IQ 
did not improve. Hence, the variable groups will be designated the 
improved groups. 

Achievement Test Results. In. the case of all three achievement scores 
the delinquents have a lower grade level of achievement than the non- 
delinquents, and in both of the major groups the constant IQ group has a 
lower achievement level than the improved group, Table 3 demonstrates 
these relationships, not in terms of absolute achievement test scores, but 
in terms of the relation of the individual's achievement level to his actual 
grade level. The actual grade level of the non-delinquents was figured on 

* For a di90ug9ioii of why they were omitted in the original report of the Kuhlmann 
Testa, see (18), pp, 16-17. 

*D/«rX)p for those two percentages is 1.71. 
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tke basis of the time of the school year when the test was given, and in the 
delinquent group it was figured as closely as possible by the grade place¬ 
ment at the time of the year when the ^rl left school. The difference 
between actual grade level and the achievement test score gives a “differ¬ 
ence achievement score." These have been averaged for each group and 
are presented in Table 3. When compared with the norms for the Stan¬ 
ford Achievement Test, each group shows some retardation in grade 
achievement. It should be recognized, however, that this is true partly 
because the ceiling of the test is too low for a few of the group who were in 
10th, 11th, and 12th grades and who made scores above the maximum 
grade level of the test. No doubt the critical ratios between delinquents 
and non-delinquents would be slightly hi^er if the norm did not stop at 
the 11.0 grade. 

Personality Test Results. The results of the other teats used in the 
battery provide data for answering the fimt question posed; namely, are 
there significant differences of personality, as measured by this group of 
personality testa, between those adolescent girls whose IQ's show signifi¬ 
cant improvement and those whose IQ’s show only slight variability? 

The Minnesota Multiphasio Personality Inventory is scored on eleven 
scales, three of which are checks on the validity with which the subject has 
answered the Inventory. These are the scores for L, and F, The 
'‘7” score is the sum of items put in the “Cannot say" category rather than 
answered as true or false. L is a lie score, which if too high, shows that 
the subject is attempting to present too favorable a picture of himself. 
The F-score is a check on how many extremely unfavorable items are 
included in the score; it includes items which normally are affirmed by 
only a few cases in a thousand. Althod^gh the F-score tends to go up os 
maladjustment ifiorenses, an extremely high F-score suggests carelessness, 
lack of comprehension, deliberate falsification, or scoring errors. The 
other eight scales are measures of specific abnormal tendencies, grouped 
under familiar psychiatric classifications. Their letter abbreviations have 
the following meanings: Hs—hypochondriasis, D—depression, Hy— 
hysteria, Pd—psychopathic deviate (formerly called psychopathic per¬ 
sonality), Pa—paranoia, Pt—psychasthenia, Sc—schizophrenia, and Ma 
—mania. 

Table 4 shows the significance of difference between the subgroups of 
each major group. The ratios do not indicate a significant difference 
between the results for the constant and improved groups, but the test 
did .discriminate extremely well between the delinquent and non-delin¬ 
quent groups. The differentiation which this scale and the other per¬ 
sonality tests made between delinquents and non-delinquents will be 
presented in a subsequent report. 
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Table 4 

Minnefiota Mviltiphoaic Personnlity Inventory—Significance of Differences of Eaw Scores 


Scale 

Delinquents, Diff. 
between Improved and 
Constant Groups 

Non-Delinquents, Diff. 
between Improved and 
Constant Groups 

First Test 
DlaD 

Second Test 
DlaD 

First Teat 
DlaD 

Second Test 
DlaD 

?-Scoro 

.12 

.55 

,27 

1,03 

L-Scoro 

.48 

.01 

.71 

1.00 

F-Scorc 

3,30 

2.07 

.76 

1.24 

Hs-Scorea 

.20 

1.90 

.35 

.53 

D-ScorcB 

.90 

.40 

.61 

1.04 

Hy-Scorea 

1.75 

.02 

1.06 

2.13 

Pd-Scoreg 

.30 

.62 

.22 

.24 

Pft-Scoreg 

.61 

l.flO 

.25 

.67 

PlrScorea 

.00 

1.35 

.43 

.64 

Sc-Scorea 

.43 

1.18 

,50 

.14 

Ma-ScorcB 

1.20 

.13 

2.25 

2.03 


The same treatment has been given the scores from the other per¬ 
sonality tests, namely, the Washbume Social Adjustment Inventory, the 
Pressey Interest-Attitude Test, and the Terman-Miles Test of Mascu¬ 
linity-Femininity. The Vineland Social Maturity Scale is a different type 
of test from these others, but may be grouped ■with them, and Table 6 

Table 6 

Other Personality Teats—Significance of Difference of Raw Scores 


Teat 

Test 

No. 

Delinquents, 
Diff, between 
Constant and 
Improved Groups 
DlaD 

Non-Dolinquonts, 
Diff, between 
Constant and 
Improved Groups 
DlaD 

Waahburne 

iBt 

,60 

1.06 

Woahburne 

2nd 

.40 

.06 

Pressey 

Ist 

2.79 

.15 

Pressey 

2nd 

3.50 

.12 

Terman-Miles 

(one only) 

1.22 

.78 

Vineland * 

(one only) 

,49 

.21 


• DlaD between social quotients. 


shows the significance of differences between each group on both examina¬ 
tions. The Washbume, the Terman-Mile.s, and the Vineland do not show 
significant differences between the constant and improved groups. That 
the Pressey shows high critical ratios between the constant and improved 
delinquents but not the non-delinquenta and does not discriminate be- 
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tween the total group of delinquents and non-delinqueuta nppcaiB to be 
a chance phenomenon. The Termnn-Miles sho-ws no significant differ- 
encea between any groups. 

Personal History. The second port of question (1) ia: arc there signifi¬ 
cant differences of background between those adolescent girls whose IQ 
showed significant improvement and those whose IQ varied only slightly? 
The first item on which they are to be compared i.s the occupational level 
of the father. In cases where the father ia deceased or not with the 
family and the mother works, the occupation of the mother was rated. 
The occupations were classified according to the Taussig (29) scale, which 
has been used by Hildreth (15) and others. Chi square was computed, 
in a five by two table, to find out if there is a reliable difference in the 
distribution of occupational level of parents between delinquents and non¬ 
delinquents and the constant and improved subgroups of each. Between 
parental occupations of delinquents and non-delinquents P-value i.s less 
than .01. Application of chi square to constant a,nd improved delinquent 
groups yields a P-value of .60, and applied to constant and improved non¬ 
delinquent groups the P-value is .04. 

The indicationa are, therefore, that there is a reliable difference be¬ 
tween the occupational level of the parents of the delinquents and non¬ 
delinquents, the occupatioTiQi level being higher for the parents of non¬ 
delinquents. There ia not a reliable difference between occupational 
levels of the constant and improved delinquent groups, but with the 
non-delinquents the difference approaches significance, the parents of the 
improved group tending to have a higher oeoupabional level than tliose 
of the constant group. 

The parents' education is another item which was investigated as far 
as possible with each group, but the educational information is more 
limited than the occupational information. In only 47 of the 101 delin¬ 
quent coses and 77 of the non-delinquenta was it possible to obtain in¬ 
formation regarding parents' education. The chi square test was applied 
in a four by two table and yielded a P-value between .01 and .02 between 
the education, of the delinquents’ parents and the parents of the non¬ 
delinquents, indicating a reliable difference in favor of the non-delinquent.s. 
The subgroups within the two larger groups are so small, due to the 
incompleteness of the data, that chi square is not an appropriate test of 
differences, and for the same reason more elaborate treatment does not 
seem indicated. 

Differences in race, nationality, and language were so small as to be 
insignificant in all groups. Only nine of the delinquents and one non¬ 
delinquent had one or both parents of foreign birth. Tive of each major 
group were not of the white race. Thirteen delinquents and two non- 
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delinquents came from bi-lingual homes. These few girls were about 
evenly distributed between the constant and improved groups. Work 
experience is another factor which differed markedly between delinquents 
and non-clelinquonts, the delinquents having worked more, but it had no 
apparent significance with respect to the two IQ groups. 

By means of the records at hand and j^rsonal interviews an attempt 
was made to tabulate any social problems within these giiis^ families, 
including problems of health, mental retardation, mental instability, and 
social maladiustment, such as delinquency or criminality. Of the delin¬ 
quents 72% of the constant IQ group had social problems within the 
family and 72% of the improved group. Of the non-delinquents 23% 
of tlie constant group and 20% of the improved group had family problems 
of the types mentioned. Again the same pattern is seen wherein there is 
conspicuous difference between delinquents and non-delinquents but little 
or none between subgroups of each. 

Three additional items were tabulated for the delinquents only. The 
type of delinquency was not related to IQ changes, inasmucli as 91% of 
the constant group and 94% of the improved group were committed for 
sex delinquency. Ratings on the home conditions of the delinquents were 
made by field workers from the State School who visit the home of each 
girl who has been committed. They used an adaptation of the Whittier 
Scale for Grading Home Conditions (34), which includes ratings on Neces¬ 
sities, Neatness, Size, Parental Conditions, and Parental Supervision. 
The ratings were examined to see if th(^ girls whose IQ improved after 
a period in the institution came from the poorest or moat unsatisfactory 
homes. There were no striking differences between the iiomes of the 
girls in the two subgroups. Ratings on the first three categories covered 
the entire range, but on the latter two, Parental Conditious and Parental 
Supervision, there was piling up on the unfavorable end of the scale. 
The third item considered for the delinquenta only was the length of time 
out of school prior to commitment. The Kuhlmann Tests are pencil-and- 
paper tests, much like school work, and it was thought that a girl who had 
been out of school for some time might find it easy to better her score after 
a return to school. However, classifying the girls’ length of time out of 
school in a four part table and applying the chi square test, a P-value of 
between .70 and .80 was obtained, so there is no evidence that length of 
time out of school prior to taking the tests had any relation to ability to 
improve the score. 

Peraonaliiy Tests {Changes from First to Second Examination). The 
second major question to be answered is whether significant improvement 
in the IQ of adolescent girls is related to improvement in the adjustment 
pattern of the total personality. Our data for answering this question are 
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the amount of change in the scores of those three personality tests wliich 
were given twice and the relation of these changes to changes in IQ. 
A second type of data is the analysis of personal-social events between 
exaininationa. 

The amount of change in scores on the personality tests was averaged 
for the vorioufl groups and compared. Table 6 shows that changes in 


Table 6 

Significanco of Differonce between Mean Changes 
of Score on Iflt and 2ntl Pereonality Tesla 


Test 

DIoD 

Changea of Constant 
and Improved 
Delinquents 

Dial) ' 

CliniiRfis of Constant 
and Improved 
Non-Delinqucnts 

Minnesota Multiphasic 
?-Scoro 

1.02 

.53 

L 

.40 

.33 

F 

1.30 

.68 

Hb 

1,90 

,21 

D 

1.03 

2,05 

Hy 

1.17 

2,00 

Pd 

1.28 

.20 

Pft 

1.82 

,31 

Pt 

1.49 

,39 

Sc 

.83 

.10 

Ma 

1.80 

.35 

Wnabburne S.A. Inventory 

1,38 

2.40 

Pressey Intereat^Attitudo 

.87 

,00 


personality adjustment as measured by scores on this group of personality 
tests occurred no more frequently in the improved group.s than the 
constant groups. More detailed examination of the score changes shows 
that there was a slight but consistent tendency for the delinquents’ scores 
to shift more toward the mean for the normal population on the second 
test, but the average change was so slight and also so evenly distributed 
with relation to constant and improved groups that it is not of significance 
for the present problem. 

PersonalrSociol HUtory in Interval helween Tests. Health frequently 
is mentioned as a cause of changes in teat performance. The health 
record for the delinquents was available at the School. With the non¬ 
delinquents A classification was made on the basis of the report of each 
girl on number of illnesaes, which was checked by records of the school 
nurse, who attempts to record causes for each absence resulting from ill¬ 
ness. In the delinquent groups 23% of the constant IQ group and 45% 
of the improved IQ group received treatment for major health conditions, 
including pregnancies. Chi square applied to all classifications yielded a 
P-valvie between. .10 and ,05, and D/o-D between the major treatment 
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categories of each group was 2.24. Although there is little likelihood of 
of the difference occurring by chance, neither test quite meets the criterion 
for a reliable difference. Tweaty«six cases in the entire group were fitted 
with glasses between examinations. They were about evenly divided 
between the constant and improved groups, but their average IQ change, 
however, was 11 points, which is 3 points higher than the average. 

The chi square teat applied to the cloaaification of health history for 
the non-delinquents yielded a P-value of .30, as compared with about .08 
in the delinquent group. No direct comparison between delinquents 
and non-delinquents can be made because of the lack of uniformity in the 
type of records, but there is more evidence tliat health was a significant 
factor in the delinquent than in the non-delinquent group. 

School grades of both delinquents and non-delinquents were analyzed 
in terms of trends in the interval between psychological examinations. 
Thirty-five of the delinquents had no school experience in this period, but 
of those who did there was no significant difference in the trend of their 
grades between the constant and improved IQ groups. In the non¬ 
delinquent group, too, the trend of grades in terms of improvement or 
the lack of it was no different in the improved than the constant IQ group. 

Three other factors were examined in the delinquent group as possible 
indicators of adjustment within the institution, namely, records of disci¬ 
pline, work ratings, and behavior ratings. These are records kept rou¬ 
tinely by the institution. The average number of disciplinary incidents 
for the constant group was 6.32 per person, and for the improved group 
it was 7,25 per person. Classification of types and quantity of discipline, 
tested by chi square, yielded a P-value between .20 and .10, which is not 
low enough to allow one to draw any definite conclusion about the group 
differences. When work ratings and behavior ratings were classified in 
terms of trends of improvement, lack of improvement, or poorer than 
before, the percentage of girls in each classification was almost identical 
for the constant and improved groups. Hence, it is not indicated that 
the group whose IQ improved showed any more improvement in adjust¬ 
ment to the institution than those whose IQ remained constant. 

Discussion 

The basic criterion for grouping these cases, of course, was the differ¬ 
ence in the scores made on two intelligence tests. On the first test the 
delinquents proved to be somewhat below average, which is consistent 
with other reports of the intelligence level of delinquents, but the non¬ 
delinquents had a mean intelligence score close to the mean for the general 
population. The test-retest reliability coefficient was satisfactorily high 
on each group, but slightly better with the delinquents than the non- 
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delinquents. The correlation between IQ change and time interval is so 
close to zero that it is impossible to say that the large changes in IQ are 
due to practice effect in the usual sense of the term, since that would 
result in a negative correlation between time interval and IQ change. 
Yet, 36% and 48% of each group, respectively, showed a change of more 
than 10 points in IQ on retest. This result, while indicating more change 
than that reported by many investigatora, notably those using tiie 1916 
Stanford-Binet, is by no means unprecedented. Lowell (21) with her 
very large group of cases reported that 7l% changed 7 points or more, 
suggesting that the mean change must have been considerably greater 
than that. Brown (5) reports on average change of 6 points, which ia 
only slightly below the average for thi.s study, and Allan and Young (1), 
using the Terman-Merrill, report reaull^ identical with the ones of this 
study which used the Kuhlmann. They found an average gain of 8 
points with 48% of the group varying more than 10 points. Variability 
such as these studies and the pi’esent one reveal is not simply variation 
around the mean inasmuch as the average change is a gain of 8 or 9 points, 
when computed with retention of the sign rather than change averaged 
regardless of sign. This gain is not to be explained by the conventional 
techniques of correlating IQ change with time interval or level of first IQ, 
as mentioned before. The range of IQ cliangea is quite similar whether 
based on the cases retested at 4 to 6 months or those retested at an interval 
of one year or more. The accuracy score on the Kuhlmann proves to be 
a rather stable index of the individual’s method of working, providing 
he is given tests properly ranged for his level of ability, but the speed score 
does have a positive correlation of .41 to .44 with changes in IQ. 

The achievement tests were used to find out whether those girls whose 
achievement level was least retarded were among those who were able to 
raise their IQ’s on retest. As mentioned in the statement of results, the 
relationship of achievement to grade level is somewhat distorted by the 
fact that the upper ceiling of the test is grade 1LO. For this reason more 
significance is attached to the critical ratios than would be warranted 
without this factor which depressed some scores at the upper end of the 
distribution. With both delinquents and non-delinquents the improved 
group showed less retardation in achievement than tho.se whose IQ's on 
retest stayed about the same. It appears that achievement level is more 
significant in this respect than the level of the first IQ. 

The personality teat which provided the richest amount of material 
regarding individual adjustment was the-Minnesota Muliiphasic Per¬ 
sonality Inventory. Although it discriminated well between delinquents 
and non-delinquents, it gave no significant differences in either main 
group between those cases wherein the IQ improved significantly and 
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those in which it did not. The same pattern is borne out by the com¬ 
parisons of total scores on the Waahburne Social Adjustment Inventory. 
Aa adjustment is measured by these teats, there is no greater maladjuat- 
ment in one group than in the other. 

The Terman-Miles Test of Masculinity-Feminity showed no signifi¬ 
cant differences between any groups, and the Vineland Social Maturity 
Scale revealed no differences in social age between those whose IQ im¬ 
proved and those whose IQ remained constant. The Pressey Interest- 
Attitude Teat behaved atypically from the other tests in showing some 
difference between constant and improved delinquents and none between 
constant and improved non-delinquents. Moreover, it did not discrim¬ 
inate between delinquents and non-delinquents. Hence, four out of five 
personality tests showed no evidence whateoever that there were marked 
differences in personality adjustment at the time of the first test between 
those whose IQ showed subsequent improvement and those whose IQ 
remained constant. The fifth teat, the Pr^sey, shows such conflicting 
results that no conclusion may be based on it. 

In general the results of the personality tests give a negative answer 
to the question of whether improvement in the adjustment pattern of the 
individual is related to improvement in IQ, although there is a slight 
tendency for the scores of the improved delinquents to move more toward 
the normal end of the distribution of acores than do the scores of the 
constant delinquents. With the non-delinquents, whose personality teat 
scores were very normal on the first testy the differences in amount of 
score changes are not so large nor are they always in the same direction, 
which suggests that they are chance fluctuations. The differences with 
the delinquents are not great enough to be statistically reliable nor to lend 
real weight to the hypothesis that improvement in general adjustment 
results in improvement of mental teat performance. 

As a further attempt to find out whether changes in IQ are related 
to changes in other factors which are indicative of the level at which the 
individual is functioning, in other words hia total personality adjustment, 
a record was made of certain other items concerning the period between 
tests. Studies of IQ changes frequently mention physical health as a 
significant factor. The health record of the delinquents does not show a 
reliable difference between the groups, but the critical ratio is high enough 
to support the belief that physical condition may be a factor with bearing 
on efficiency of teat performance. The present results lend support to the 
opinion of many psychologists that a test given at a time when an indi¬ 
vidual is not physically up to par should be repeated at a more favorable 
time. No one can judge with accuracy just which physical ailments 
affect mental performance and which do not. 
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Returning to the questions posed at the beginning of the study, we 
shall sum up the results within that framework. The only differences of 
personality and experiential background between those adolescent girls 
whose IQ^s show significant improvement and those whose IQ's remain 
relatively constant are that those who do. not improve so much on the 
second test tend to have more retardation in level of school achievement 
than the variable group, and they tend to come from homes in which the 
parents have a lower level of education and occupation. Of the changes 
occurring between tests, there were no significant changes in the improved 
group 03 compared with the constant IQ group of the non-delinquents. 
In the delinquent group those who showed the greatest improvement in 
IQ were the group who had a poorer health record, so presumably it con¬ 
tained more girls who were not in good physical condition at the time of 
the first test. 

This lack of proof for the significance of emotional factors in the test 
situation, at least for adolescent girls, carries some implications for the 
clinician. In recent years whenever a clinical psychologist cannot find 
any evident reason why an IQ changed significantly, it has become the 
custom to fall back on the idea that the individual may be better adjusted 
at the time of the second test, a statement rarely backed up by any data. 
Although there is a possibility that in some cases this is true, it is by no 
means a common or easily demonstrated cause for shifts in IQ at the 
adolescent or adult level. The problem in young children may be quite 
different and also with older adults, who often are tested at the time of a 
court trial or some other emotional strain. The latter situation is some¬ 
what similar to the situation of these delinquents when given their first 
test, but one is not privileged to generalize these conclusions beyond the 
adolescent group. The great emphasis put on emotional factors by psy¬ 
chologists, psychiatrists, and social workers has made all persons dealing 
with maladjusted individuals particularly conscious of them, and the 
present study in no way minimizes their importance to the individual or as 
a determiner of behavior, but only minimizes their effect upon mental test 
performance. 

Summary and Conclusions 

Two groups of adolescent girls, 101 delinquents newly admitted to a 
State School for Girls and 85 public school girls, whose ages ranged from 
12 to 19 and whose median grade placement was 9Lli grade, were given an 
individual intelligence test, an achievement test, and a battery of per¬ 
sonality tests. They were retested from 4 to 15 months later. Delin¬ 
quents and non-delinquents were divided into subgroups composed of 
those whose IQ’s on retest changed 10 points or less, called the constant 
groups, and those whose IQ's improved more than 10 points, called the 
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improved groups. Differences of personality adjustment were measured 
by computing significance of difference of the mean scores for each group 
on the personality tests and by classifying and measuring the significance 
of difference of other items, such as occupation and education of parents, 
racial and national background, language in the home, work experience, 
length of time out of school, type of delinquency, other known social 
problems in the family, and Iromc ratings. In the interval between tests 
school grades and health recorda were compared, and—in the delinquent 
groups—discipline records, and work and behavior ratings. Differences 
were computed between the mean amount of change in scores on per¬ 
sonality tests given in the second examination. 

The following conclusions appear to be warranted: 

1. The non-delinquents showed ns large shifts in IQ on retest as the 
delinquents. 

2, In both delinquent and non-delinquent groups those who showed 
less improvement in IQ on retest showed the greater amount of achieve¬ 
ment retardation. 

3, There were no significant differences in the degree of adjustment at 
the time of the first test or in the experiential background between those 
who improved on retest and those whose IQ remained relatively constant. 

4, There were no significant diffetencra between the constant and 
improved IQ groups in relation to the personal-social history which took 
place in the interval between tests. 

5. There were no significant differences of personality adjustment 
between the constant and improved IQ groups at the time of the second 
test. 

6. Concomitant personality factors, ns measured by these tests and the 
criteria set up by this study, do not have any demonstrable effect on the 
changes in mental test performance between teat and retest of adolescent 
girls. 
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Studies in the Symbolism of Voice and Action: V. The Use of 
Behavioral and Tonal Symbols as Tests of Speaking 
Achievement 

Franklin H. Knower 

Vni\iertily of Iowa 

There are two general lines of procedure which may be followed in 
initiating a program of research in test construction. First, one may begin 
with a large number of items selected because of some presumed diagnostic 
value in the test, and then, through a program of item analysis, select and 
retain those items which contribute most to tlie value of tlie test, In 
following the second method, one begins with a limited number of items, 
retains those found to be useful and then adds to them as the evidence 
indicates a need for additional items to improve the value of the test. 
The firs^t method may be said to be most satisfactory in dealing with tests 
of a nature comparable to those of already known value. The second 
method is to be preferred in the development of tests which are essentially 
different from those of established patterns, for unless a test of a limited 
number of items can be shown to have some usefulness, the possibility 
that a test of a greater number of items will be of value is immediately 
open to question. 

The second method just described has been employed in the work on 
the tests used in this project. The data to be presented are to be inter¬ 
preted, therefore, oa preliminary findings. 

The use of tonal and behavioral symbols as a supplement to linguistic 
means of communication long have been considered by critics as signifir 
cant factors in the process of speaking. A number of recent studies have 
supported this impression. 

Monroe ‘ found that two of the more important elements in the second 
factor revealed by his factor analysis of the characteristics of good speech 
were "Used good gestures" and "Voice not monotonous." Barnes® re¬ 
ports "Monotonous voices" and "Poor bodily control" as relatively high 
frequency faults among the speech students he studied. In a study by 

^ Monroe, Alan H. The meRsurement and analyaia of audience reaction to student 
Bpeakera. Studies in Higher Education, Purdue XJnivOTaity, xxxii, 1937, 

* Barnes, Harry G. A study of tUo speech needs and abilities of students in n iiret 
course in epeecli training at the college level. Unpublished Doctoral Dissertation, State 
University of Iowa, 1932. 
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Gilkinson and Knower * ''Monotonous voices,” "Inanimate bodies” and 
“Little facial expression” were not only indicated na high frequency faults, 
but were also shown to be speech characteristics dearly differentiating 
speakers of superior from inferior quality. At one point in their report 
on the Michigan Cooperative Study, Hayworth and colleagues ^ have 
indicated that the number of "Meaningful facial expressions per minute”' 
was found to be a factor of relatively high weight in the determination of 
“Total effectiveness of speech delivery.” At another point in their report 
on the evaluation of specific testa of "Vocal interpretative ability,” 
“Pantomiming ability,” and "Facial expression,” their data indicate 
moderate to marked relationship with "Public speaking effectiveness” for 
the first two tests; and approximately a zero correlation for the test of 
"Facial expression.” The absence of an indication of relationship in the 
second test may be attributed to the inadequacy of tho particular test 
used. 

With the exception of part of the data in the Hayworth study, all of 
the data obtained on this problem in previous studies have been secured 
by the processes of rating a speaker on his use of these symbolic processes 
during the activity of speaking. The data in this study, on the contrary, 
arc not derived from an evaluative judgment on the quality of the per¬ 
formance, but as explained later are actual intorpretations of meaning. 
This investigation was undertaken to secure data which might throw light 
on. the answers to the following questions. 

1. la it pQaaible to develop reliable and valid obiectivc group teats of a 
speaker’s skill in the use of tonal and behavioral symbolism as such? 

2. What can we learn from such objective tests about the relationships 
of such skills to the total effectiveness of the speaker in speaking, and to 
other characteristics of the speaker as a person? 

The tests upon which this study are based are adaptations to group 
testiug purposes of the measuring instruments used in the study of tonal 
and visible symbolism reported in the Quarterly Journal of Speech by 
Dxisenbury and Knower.® The test form consists of a sheet of paper 
containing in the left hand margin a list of eleven emotional states each 
designated by three terms selected to facilitate the recognition of the 
particular qualitative or quantitative differences in the emotional states 
to be expressed. A series of columns acros.s the sheet are arranged to 
permit judges to record their interpretations of each performer’s stiinula- 

® Gilkinson, Howard, RncI Knower, Franklia H. Paycliological atudiea of indivicliuil 
differences among students of speech. Univ. of Miiuicaotn, Department of Speech, 1930. 

‘Hayworth, Donald, A Ttsta,T<Jvintoii{eieo,iJ\.xnQQf publtc speaking. National Asso¬ 
ciation of Teachors of Speech, Detroit, 1940. Pp. 231. 

®Dusenbury, Delwin, and Knower, IVanldin H. Experimental atudiea of the sym¬ 
bolism of notion and voice. Quort. J. Speech, 1938, 24, 424-436; 1039, 25, 67-74. 
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tion In each performance. As each student is tested his name is placed 
at tli6 head of a column and recorders’ interpretations are placed below it. 
The recorder's name and other data are provided at the top of the judging 
sheet. 

Directions to the performers for the teat of behavioral symbolism were as 
follows; “At the next meeting of the class you will be called upon to indicate 
the way you would express the eleven emotional states indicated on this sheet 
by facial goafciires or pantomime. Although you are expected to depend pri¬ 
marily upon facial expression you may ollow your body to adapt to the expres¬ 
sion you are trying to indicate in the face. You are requested especially to 
avoid hand gestures of conventional meanings. You are to use your articulators 
as if you were saying the letters of the alphabet from ‘a' to 'k,' bub you are not 
to form words with your lips which might be interpreted by lip readers. You 
are asked simply to express the emotions indicatal ns you would simulate them 
if you were portraying the emotions of a character in a atory you were telling 
or in a piny you were acting. During the class period I will call you to the desk 
on the platform one by one and hand you a scries of cards one at a time on which 
have been typed the terms for the eleven emotional states to be expressed. As 
I hand out each card I will call out numbers from '1' to '11' and record these 
numbers on a key slieet for correcting the responses of the observers, .The 
stimulus cards will be shuffled after each performance to vary the order for the 
next performance. You are expected to take only two to three minutes for 
the entire series of eleven expressions and you must therefore respond as quickly 
to the cue cards as you would to the cue lines in a play." 

Tile directions for the members of the class, who served as judges when not 
performing, wore as follows: “You are to place each performer’s name at the 
top of the column in which you record the judgments of his performance. As 
I call each number observe the speaker carefully, look quickly down the list 
of eleven emotional states and record the number in the proper column opposite 
that emotional state which in your judgment the speaker is simulating, You 
arc to record a judgment for each number, and record each number opposite 
only one set of terms. After the first expression for each performer, if you 
interpret a later expression as the simulation of an emotion for which you al¬ 
ready have one judgment, you may place the second number also opposite tho 
terms for that emotion. For every set of terms on which you record more than 
one judgment, you will leave one set of terms without a number. You should 
familiarize yourselves with the list in order to record your judgments rapidly." 

The directions for performance in tho tonal test differed from those for the 
visible symbolism only in the following manner. “At the next meeting of 
the class I will call each of you to the back of tha room and ask you to 
simulate a tonal expression of each of the emotional states indicated on this 
sheet. You are to use no words but in giving tonal body and pattern to the 
expression you are to articulate the letters of the alphabet, from 'a' to 'k.' " 

The process of judging the tonal expressions differed from the process 
of judging tho facial expressions only in that the judges listened to the 
tonal expressions rather than observed the behavior of the speakers. As 
has been indicated, the instructor in the class made a key during each 
performance for the purpose of checking the corrcyitness of interpretations. 
Since in no case were there fewer than sixteen persons in the class section 
tested, there were at least fifteen judges for each performance. 

The tests were scored in two ways. First the number of correct judg- 
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ments for each performer were divided by the total number of judgments 
^hen checked against the key to provide a score in terms of a percentage 
of audience comprehension of each performance. Secondly, the number 
of correct judgments rendered by each judge was divided by the total 
number of his judgments to provide a score in terms of the percentage of 
Mg comprehenaion of the performancea of all other members of the cloag. 
Although the class average for the performances and judgments were of 
course always the same, marked differences in individual ability of both 
types occurred within most Glasses. 

Before analyzing the data from the study, it may be well to consider 
some of the advantages and limitations of tests of this type. On the 
question of their desirable features, I wish to call attention first to the fact 
that these teats are actual tests of the social dynamics of speech. The 
score in no way depends upon an auditor's interpretative judgment of the 
excellence of the performance, but only on the specific percentage of the 
speaker’s intelligibility. Since the tests are of this type they may be used 
to analyze individual differences in the nature of the behavior of both 
speakers and auditors. A relatively large number of persons can be 
tested in the average class period in a situation which approaches normal 
student speaker-auditor relationships. The fact that tlie test may func¬ 
tion as a learning activity commends it as a classroom exercise apart from 
its test features. 

Such tests may be criticised as abatractioiiB in that they isolate tonal 
and behavioral symbolism from their normal accompaniment in speech of 
linguistic expression of ideas. While this ciiticism is obviously sound, it 
is probably not more true for the test in question than for typical tests of 
articulatory or linguistic skill. Although intelligent persons do not ordi¬ 
narily go about engaging in unprovoked facial activity or vocal noises, 
neither do any but school teachers and other intellectually curious persona 
go about randomly articulating phonemes, declining adjectives or parsing 
sentences. These charactemtics of tests probably are necessary limita¬ 
tions of the problem at hand. Although the tests may not provide an 
adequate index of refinement in the use of non-linguistic symbolism for 
advanced students, the limitation of scores to intelligibility provides a 
sufficient top for most students with limited speech skills. A third ques¬ 
tion may be raised concerning a test of a speaker's performance which 
limits the index of his skill to the comprehension ability of his audience. 
This might be a serious limitation were it not for the fact that in almost 
every class tested the range of scores on performance has been moderately 
high. Data will be presented which indicates that in a class of at least 
fourteen judges the reliability of the tests ia sufficiently high for purposes 
of group analysis. 
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The major data on the project are presented ia Table 1. The correla¬ 
tion of the performance scores of subjects as interpreted by seven judges 
with scores as interpreted by seven additional judges produces what may 
be called a split-half index of the reliability with which performances are 
judged. When corrected for the split-half technique, the reliability cor¬ 
relations for scores on behavioral symbolisni were +.93 and for tonal 
symboliam +.87. The individual performances, then, were reliably in- 


Table 1 

IteliabiHty and Validity Correlationa 



Qeliavioral Symbols 

Tonal Symbols 


Perf’nce 

Judg’nt 

Pert'nce 

Judg'nt 

Seven with Seven Judges 





(Corrected) 

.93 ± .01 


.87 ± .02 


Test-Hetest 

Speech Ptgs. for General 

.62 =b .05 

.69 d; .03 

.66 ± .03 

.92 ± .01 

Effccb'nesB 

.47 ± .04 

.66 ± .04 

.26 ± .06 

.66 :b .04 

Speech Rtga. for Adjustment 

.42 =t .06 

.40 ± .06 

.34 ± .05 

.41 ± .06 

Speech Etga. on Phonntion 
Performance with Judgment 



.31 zb .05 

.46 d: .04 

(lat TciJb) 

Porfonnanco with Judgment 


.67 ± .03 


.49 ± ,04 

(2nd Teat) 


.33 ± .06 


.66 ± .06 


terpreted. To determine whether or not the expreasional skill of the 
individual was consistently characteristic of hia performance, each test 
was repeated after an interval of one week for 100 subjects. The second 
line of the table indicates these test-retest correlations. Although these 
correlations indicate a substantial amount of consistency in the traits 
measured, they also indicate that there was considerable variation in per¬ 
formance on the second test, with skill in the use of tonal symbolism 
varying less than skill in the use of behavioral symbolism. Since the 
indices or scores for each performer are based on the average accuracy of 
interpretation of fifteen listeners,—where fourteen judges produced re¬ 
liability of +.93,—these correlations cannot be attributed to the unre¬ 
liability of the particulai' scores. These testrietest correlationa were 
seriously affected by the average gain in the effectiveness of performance 
on the second test, and by the fact that the range of scores was consider¬ 
ably reduced on the second test. Since the average gain in effectiveness of 
the use of tonal symbolism was as high as the average gain in effectiveness 
of the use of behavioral symboliam the higher test-retest correlations for 
the test of tonal symbolism indicate that fewer subjects approximated the 
top of the tonal teat than the behavioral teat. This assumption is sup- 
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ported by the fact tliat the mean level of performance in tlic use of tonal 
symbols was considerably lower than the mean level of the skills in be¬ 
havioral symbolism. 

The correlation indices of validity may be best described as moderate 
to marked in comparison with other tests of this typo. Those data arc 
inconsistent with those reported by Hayworth in tlmt tin's test of per¬ 
formance in the use of facial expression appears to bo more closely related 
to speech skill than does the test of the use of tonal Hyinbolisin. An 
interesting feature of these correlations is found in the fact tliat ratings on 
performance are more closely correlated with skill in judgments of per¬ 
formance than with skill in performance itself. If this phenomenon 
should be found to be consistently true of this type of test, and if these 
validity correlations may be improved by the development of the tests, it 
will mean that since judgment scores may be obtained more conveniently 
than performance scores, the potential usefulness of the tests will be 
greatly improved. 

Table 2 

Means and Standard Deviations of the Distributions 



First Fcrfornuince 

Second Performance 

Means 

S.D. of 
Perl. 

S.D. of 
Judg, 

Means 

S.D.of 

Perf. 

S.D. of 
Judg, 

Behavioral Symbols: 







rreahman (Required) 

62.70 

ID.IO 

14.10 

71.10 

13.10 

10,60 

Sophomores (Elective) 

70.90 

10.85 





Tonal Symbols; 







Ereshmen. (Required) 

45.10 

13.70 

0.15 

57.40 

13.50 

10,90 

Sopliomores (Elective) 

06,80 

13.96 





Acting Ckss 

83.30 

4.95 






Table 2 contains some additional data on validity in the form of means 
and standard deviations of distributions of scores for various groups. A 
group of 50 sophomores in an elective course in speech were compared 
with 100 freshmen in a required course and found to be eight per cent more 
intelligible in the use of visible symbolism and twenty-one per cent intelli¬ 
gible in the use of tonal symbolism than were the freshmon. The differ¬ 
ence between the two groups is highly significant in the use of tonal 
symbolism and probably reliable in the use of visible symbolism. Nine¬ 
teen students in an advanced class in acting received scores on the tonal 
test that were significantly higher than the scores received by the 
sophomores. 

The standard deviation of the judgment scores of the freshmen on the 
first tests are here seen to be considerably higher than their deviation on 
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(,he second tests. The amount of improvement on the second tests is also 
indicated here in terms of higher mean scores on the second testa. I 
should like to point o\it that, although these mean scores are considerably 
lower than those reported by Duacnbmy and ICnower's advanced per- 
formoi'S, they are still high enough to indicate that a highly significant 
amount of oommunicatiozi may take placfi through the use of tonal and 
belmvioral symbolism by the average college student, 

In concluding, I wish to comment on the last two lines of correlationa 
in Table 1. In spite of apparent differences in skill in performance and 
judgment these correlations indicate a considerable relationship between 
these two traits. The relationship appears to be more constant in the 
area of bonal symbolism than in the area of visible symbolism. These 
data support the suggestion previously advanced that a group test of skill 
in the judgment of tonal and belmvioral symbolism might be developed 
which will provide a useful test of skill in performance. Such tests are 
useful as classroom checks on the development of significant aspects of 
speech achievement. 


Recdued May 11, 



Participatioa in High-School Football as a Factor Affecting 
College Attendance and Scholarship 

Erwin J. HenniHE and Harold D. Carter * 

School 0 / Sducalion, Unitmsiiy of California 

Doea participation in high-sehool football exert a significant influence 
upon the educational plans and later educational careera of liigh-scliool 
students? If BO, "what are the effects of such participation, and how do 
they operate? These questions, which have long been subjecta for heated 
discussion as well ag for organized inquiry, are approached again here, 
with a variation in technique that appears to be new to tiiis field of 
mvestigation. 

In order to develop a standard for ratimating the effect of playing 
football on the educational careers of the players, a control group was also 
studied. Each high-school football player was matched with a classmate 
who did not play football. The college attendance and achievement of 
the control group were used as norma for comparison with the performance 
of the athletes. 

Records wore taken for 2,875 pupils, including 220 football athletes, 
graduating from four large high achoolg in the years 1935-1937 incluBivo. 
These high schools were all situated in the urban area on the eastern side of 
San Erancisco Bay. The 220 football players were matched with 220 
of their classmates on the basis of six criteria, namely: (1) school; (2) date 
of graduation; (3) high-school acholarslilp; (4) average measured intelli¬ 
gence; (6) reading quotients aa measured by standardized testa; and (6) 
college preparatory study load, os measured by the number of units 
earned in courses which satisfy prescribed college entrance requirements. 
In the pages which follow, a detailed report ia made concerning the high- 
school work and the college attendance and scholarship of the two 
groups. 

Significant Earlier Studies 

The controversy over college recruiting and subsidizing of atliletes, 
which was at its height in the lata 1920*8, precipitated the famous Carnegie 
investigation reported in 1929 in the bulletin on American College 
AthlatiGa (4), In that tcflcarch the case ^udy technique was emphaaixed, 

* The writeTs we indebted to Br. lUAiert Gordon Sproul, President of the University 
of California, for his encouragement, and for financial oaaistance which made the study 
possible. 
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Investigatora traveled from college to college studying conditions pertain¬ 
ing to the treatment of athletes, Md reporting their findings. An accom¬ 
panying survey of the literature resulted in a separate publication reported 
in the 24th bulletin of the society (5). This is an authoritatively com¬ 
prehensive sui-vey of the literature on athletics up to 1929. By 1933, the 
Carnegie Foundation had spent $125,000 on its inveetigationa of athletics. 

The Carnegie research found previous studies on the relation between 
scholarship and athletics ill-controlled and inconclusive. Lack of uniform 
definitions made it impossible to compare results in the various schools. 
For this reason, Howard Savage, who directed the Carnegie investigation, 
sponsored a study of scholarship and athletics at Columbia University. 
This study served as a model for coordinated projects in 52 colleges (15). 
Nearly all later research on the scholarship of athletes in college has also 
followed Savage's model. The various investigations demonstrate that 
the athlete tends to be slightly inferior to the non-athlete in measured 
intelligence and in grades earned, but not enough so as to interfere seri¬ 
ously with his scholastic work. Athletes take a normal study load and a 
normal variety of college courses, and have slightly smaller academic 
mortality than non-athletes; however, more athletes than non-athletes 
receive grades near the failing mark, and more are on probation, These 
studies show a difference among sports, with sports for individuals, such 
as tennis, golf, track, etc., ranking high when judged by the academic 
achievement of participants, whereas team, spectator sports such os 
baseball and football rank low when judged by the same criteria, Later 
college investigations such os those by Tuttle (18), Hackensmith and 
Meller (10), Maney (12), and others tend to confirm the findings reported 
in the Carnegie Foundation studies. 

In the field of high-school athletira, Reals and Rees (14), Mathews 
(13), Hull (11), and Allen (1) find athletes slightly inferior to their non- 
athletic fellows. In no cose is the reported difference large. Cormany 
(7), Cook (C),' Ecu (2), Schulmau (16), and Shannon (17) report high- 
school athletes equal or slightly superior to their classmates. Several of 
these reports show that while athletes tend to be inferior to their fellow 
students who are active in other extra-curricular activities, they tend to 
be superior to those who have no extm-curricular interests, Davis and 
Cooper (8) reviewed 41 studies in this field, and concluded that probably 
the non-athletes are slightly superior to the athletes, but that the differ¬ 
ence is not significant either statistically or educationally, 

The above are but a sampling of the reports on athletes in high school 
and in college. Very few studies have followed high-school athletes into 
college. To do so seems desirable, since the controversy rages over the 
inducing of high school athletes into college by promises of glory, financial 
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rewards, or lowering of academic BtandardR. Buck (3) studying 1098 
high-school boys in Colorado, found that 21.8 per cent of tlie athletes 
planned to go to college, whereas only 11.6 per cent of the non-athletes 
planned to do so. He gave no data as to tiic relative college iiualifications 
of the two groups. Among the atldetcs, the athletic prestige of the col¬ 
lege stood first in determining a specific choice, whereas thi.s was last in 
the list for non-athletes, Relatively mote athletes than non-athlctcs 
persisted in college until they received a degree. Hero again, only monger 
data are presented as to the relative quoKficationa of the two groups. 

The present study is unique in that it begins with high-scliool groups 
of equivalent academic qualificatioiiB, and follows them into college. 

High-School Records 

A by-product of matching football athletes with controls was the 
accumulation of a large mass of data regarding the higlKsohool records of 
all athletes and non-athletes. These data are entirely in agreement with 
the literature on the scholarghip and ability of high-scliool athletes. 
Table 1 presents the results. They show the non-athletes to be slightly 
though consistently superior to the football players. 

These data have more value than merely substantiating the extensive 
literature in the field. By falling completely in agreement wi bli numerous 
other investigations, they deraonatrate the typicalncss of the high-school 
sample used here, and hence indicate the validity of our further findings, 
They encourage one to generalise with confidence beyond the four specific 
high-school populations studied. 

The above-mentioned data ore for total populations, showing that 
the football athletes closely resemble the rest of the student body. Tor 
the matched pairs, however, the Eeaemblance is still closer as a result of 
the process of matching, llie median difference between the football 
players and their controls in grade point ratio, intelligence quotients, 
reading quotients, and type of hi^-sohool load is only .19 times as large 
as its standard error, demonstrating the practical identity of the qualifica¬ 
tions of the matched groups. This identity is necessary to satisfy the 
basic premise of this study. If athletes and their controls are substan¬ 
tially identical in the qualifications which ordinarily determine college 
entrance and success, then the average college experiences of the two 
groups should also be identical within statistical limits of clianee variation, 
provided that playing football in high-school baa no influence in college. 
Conversely, any real variation between the experiences of the two groups 
is attributed to the football qualifications of the experimental group. 
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Table 1 

High School Record of Football Athletes Comparod with That of Varioua Other Groups 



AT 

Mean 

Comparing 

Lines 

Diff. 

Uiff. 

S.E.Dur. 

Grade Point Ratio: 






1. All football players 

220 

2.47 




2, All others 

2655 

2.54 

1&2 

.07 

1.82 

3. Matched control group 

220 

2.47 

1 & 3 

.00 

.00 

4. Athletes attending college 

133 

2.02 




5. Controls attending college 

99 

2.76 

4& 6 

,14 

2.10 

Intelligence Quotients: 






1. All football players 

220 

106.44 




2. All others 

2655 

107.94 

1&2 

1.50 

1.72 

3. Matched control group 

220 

106.80 

1 & 3 

.30 

.32 

4. Athletes attending college 

133 

110.31 




5. Controls attending college 

99 

112.71 

4:&- 5 

2.40 

1,92 

Reading Quotients; 






1. All lootball players 

220 

107.10 




2. All others 

2655 

110.58 

1 & 2 

3.48 

3,07 

3. Matched control group 

220 

108.8*1 

1 &,-3 

1.54 

1.05 

4. Athletc-s attending college 

133 

110.42 




5. Controls attending college 

99 

113.90 

4 5 

3.48 

2.06 

Number of Half-Units College 






Preparatory Courses: 






1. All football players 

220 

25.98 




2. All others 

2065 

25.30 

1 & 2 

.67 

1,69 

3. Matched control group 

220 

25.57 

1 & 3 

.40 

.79 

4. Athletes attending college 

133 

27.95 




6. Controls attending college 

00 

28.13 

4 &5 

.17 

.20 


Plans to Attend College 

More football athletes than controls planned to go to college, as indi¬ 
cated by tranacriptB sent. Tabic 2 shows that 28.2 per cent more atliletes 
than controls sent transcripts to college. This difference is 7.52 times 
its standard error, and hence is statistically significant. The University 
of California received more enquiries from athletes than from controls, but 
the diflerenco is not significant. All college receiving fewer than three 
enquiries from prospective students in this group wore classified as “mis¬ 
cellaneous” colleges, In the aggregate, these miscellaneous colleges re¬ 
ceived 47 enquii'ies from football students and 37 from controls. The 
difference is not significant. Besides the University of California and 
the miscellaneous colleges, thirteen other colleges received transcripts 
from prospective students. Of these, the seven receiving the majority 
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of the transcripts were all local institutions which emphasize football, 
This is the group of colleges which received significantly more transcripts 
from football athletes than from members of the control group. 


Table 2 

Planned and Aetjal Colbgp Attendance of Membora of Matched Ciroiips 



Football 

Control 



Uiff, 


Group 

Groiip 

DilT. 

R.K.d 


Flaiiitetl college attendance ns indi- 






cated by transcripts: 

Total number sending transcripts 

201 

130 




% of 220 sending transcripts 

91.4 

63J2 

28.2 

3.75 

7,52 

Number planning to go to U.C. 

77 

60 




% ol 220 planning to go to U.C. 
Number planning to go to 13 

35.0 

30.0 

5,0 

‘1.40 

1.12 

colleges 

% of 220 planning to go to 13 

78 

30 




colleges 

35.4 

16.4 

19,0 

1.07 

4,67 

Actual college attendance of mom- 






bera of matched groupsi 

Total number going to college 

133 

09 




% of 220 going to college 

60.5 

45.0 

15,6 

4,(59 

3.30 

N\imber going to U.C. 

02 

SO 




% of 220 going to U.C. 

28.2 

25.5 

2,7 

4.21 

,01 

Number going to 13 colleges 

53 

24 




% of 220 going to 13 colleges 

24.1 

10.0 

13.2 

3.54 

3,73 


College Attendance and High-School Scholorship 

Table 2 summarizes facts from the college attendance records of mem¬ 
bers of the matched groups. 2.8 per cent more athletes than controls 
attended the University of California; the difference is negligible. 13,3 
per cent more athletes than controls attended the thirteen colleges; this 
difference is significant. Eighteen football athletes and nineteen controls 
attended miscellaneous colleges. Thus a total of 133 athletes attended 
college, compared with 99 members of the control group. The difference 
is 3,09 times as large as its standard eiTOr. The excess college attendance 
of athletes over controla is due almost entirely to the fact that the thirteen 
colleges accepted more athletes than members of the control group. TJie 
inference follows that the excess college attendance of the athletes is due 
to their high-school football experience. 

The data in Table 1 permit comparison of the qualifications of the 
athletes who attended college with the qualifications of the controls who 
did so. The athletes tend to be inferior to the controls, Which colleges 
accepted these inferior students? The qualifications of the members of 
the matched groups who attended the m^cellaneous colleges are nearly 
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equivalent. The data for jnembera of the matched groups attending the 
thirteen colleges and the University of California are compared in Table 3. 
At the University of California the high-school football students -who 
entered college came with generally better qualifications than those of 
their controls. At the thirteen cdleges the reverse was true. Table 3 

Table 3 


Comiiarieon of lligh-Schoal QualificatioDs ot Pbotbali Athietea and Control Groups 
Attending the Univereity of Califomia and the 13 Collegea 



Footbnll Groups 

Control Group.s 

U.C. 

13 Colleges 

U.C. 

13 Colleges 

Number attending 

62 

63 

56 

24 

Mean high-scliooJ gmde-point ratio 

2.90 

2.36 

2,80 

2,58 

Dificrence between mcana 

.62 


,31 


Standard error of difference 

.08 


.13 


Critical ratio 

6.23 


2.37 


Mean high-Bchool IQ 

114.07 

107.00 

113.43 

110.33 

Difference bctiveen means 

7.07 


3,10 


Standard error of ditferenco 

1.74 


2.29 


Critical ratio 

4.00 


1.35 


Mean high-echool reading quotient 

112.10 

ioa.98 

1113,11 

113.01 

Difference between means 

3.12 


.10 


Standard error of difference 

2.40 


2.82 


Critical ratio 

1.27 


.04 


Mean number Imlf-units college 





preparatory courses 

29.71 

26.25 

28.82 

27.38 

Difference between means 

3.46 


1.44 


Standard error of difference 

.93 


.60 


Critical ratio 

3.72 


2.40 



emphasizes this situation by comparing the football students who at¬ 
tended the University of California with the football students who at¬ 
tended the thirteen colleges. A Rimilar comparison is made for members 
of the control group who attended these schools. 

In all cases the high-achooi qualifications of students attending the 
University of California were superior to the average qualifications of 
those who attended the thirteen colleges. This is true both for athletes 
and for controls. The Uzuveisity trf Califomia attracts the better stu¬ 
dents from this area. However, the differences between the qualifications 
of the controls who attended the University of California and the thirteen 
colleges were relatively small and statistically non-significant. The criti¬ 
cal ratios are displayed in Table 3. Thus while the state university 
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attracted generally better-qualified students than the thirteen colleges, 
the differences -were small for ordinary students. The seven local colleges 
emphasizing football, however, attracted and accepted football students 
who were definitely inferior in academic ability and acliievoment. Since 
this is not true for non-football students, the results suggest a lowering of 
standards by these local colleges, for prospective football players. The 
same results indicate that at the University of California standards were 
not lowered for football players. 


Table 4 

iVveragc Grade-Points Ratios Earned in College hy Members of Matched Groups 



N 

hilcan 

Diff. 

y.F.ij 

Diff, 

ii.F.Diit. 

Uiiiveraifcy of California 






Football Gronp 

62 

1.272 




Control Group 

56 

1.141 

.131 

.081 

1.02 

Thirteen Colleges 






Football Group 

53 

0.782 




Control Group 

24 

1.105 

.323 

.187 

1.73 

Totals 






Football Group 

115 

1.046 




Control Group 

80 

1.133 

.087 

.080 

1.01 

Table 4 shows 

that at 

the Univeraty of 

California the 

football 


athletea earned slightly higher grades than members of the control group 
The difference is so small, however, as to be insignificant. On the other 
hand, tJic grades received by football playcm in the thirteen colleges were 
inferior to those of their controls. These results arc exactly in agreement 
with the high-school qualifications of the groups concerned. Thus while 
the thirteen colleges accepted football playere with inferior qualifications, 
the grades given them wei-e not out of line with their abilities. Appar¬ 
ently the influence which gets these inferior students into college does not 
extend to the classroom teachers who assign them grades. 

Other Compaiisons 

A number of additional Gomparisons are furnished in Table 5. Of 
the football players enteiing college, 45,1 per cent were eventually gradu¬ 
ated, as compared with 42.4 per cent of the controls. TJius, in spite of 
inferior entering qualifications, the atliletes were graduated at least ns 
frequently as were the controls. 

The types of college courses pursued by athletes and controls were 
equally distributed. While the athletes took fewer technical and com- 
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Table 5 


MiscellauGoos Datii Concerning Mcmbora of Matched Groups Who Attended College 



Football Group 

Control Group 

N 

% 

N 

% 

University of California: 





Number who attended 

G2 


6S 


Average no. of somestorh 

7.6 


7.0 


Number graduating 

36 

58 

33 

59 

Semcatera on probation 

53 

11.3 

33 

8.4 

Number dismiasoJ 

10 

16.1 

7 

12.5 

Thirteen Colleges: 





Number who attended 

53 


24 


Average no. of semesters 

4.3 


4,0 


Number graduating 

10 

25.8 

7 

20.2 

Semesters on probation 

25 

10.9 

13 

13.5 

Number diBmiaseJ 

7 

13.2 

1 

4,2 

MiscellaneoiiB CoUegos; 





Number who attended 

IS 


19 


Average no. of semesters 

4.3 


3,7 


Number graduating 

5 

37.8 

2 

10.5 

Total Group: 





Number in college 

133 


gg 


Average no. of Bcmcstera 

5.8 


6.6 


Number graduating 

60 

46.1 

42 

42.4 

Semesters on probation 

78 

II.2 

46 

0.4 

Number dismissed 

17 

14.7 

8 

10.0 


mercial courses than the controls, they took about the same number of 
professional coui’ses, arts courses, and vocational courses. The distribu¬ 
tion is normal enough to refute the argument that athletes take only easy 
courses in college. 

As to the relative numbers of the two groups who were on probation, 
numbers of honors received, and numbers of semesters in attendance, the 
data tend rather consistently to favor the control group, but by very 
small margins. 


Star Athletes 

From the group of 220 athletes, the sixty most outstanding football 
players were selected, These were compared with the other athletes, with 
the controls, and with the general population. No data, either in high- 
school or in college, yielded sufficiently large differences to permit one to 
conclude that the sixty star atiiletes enjoyed an experience in any way 
atypical for the whole football group. 
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Summary anti Concluaions 

A study has been made eomparing the college attendance and scholar¬ 
ship of 220 high-school football athletes wth similar data for 220 of their 
classmates -who did not play football. The two groups wore carefully 
matched for intelligence and high-achool acliolarahip, The data lead to 
the following conelusione •. 

1. In comparison with other students of equivalent academic qualifica¬ 
tions, football athletes more often plan to go to college. 

2. A greater proportion of football athletes octually do go to college. 

3. A greater proportion, of football athletes graduate from college. 

4. The football athletes have slightly inferior high-school records. 

5. The football athletes tend to enter certain colleges in which football 
IS a prominent sport. It is inferred that standards of admission in these 
colleges are lowered for prospective football players. 

Received Map S6,19^. 
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Two Methods of Comhming Attitudes of Like, Indifference and 
Dislike Into One Score 

Philip Eisenberg 

Colujn^ioBroodcaslinpSystew, Inc., Ntw York Giiv 

In radio research, as in many other fielda of inveafcigntion, the social 
scientist frequently aska his subjecta to express their like or dislike of a 
stimulus, Since it is undesirable to force the individual to express like or 
dislike when he ia not sure of hia opinion or when lie does not feel strongly 
either way, he is frequently permitted to express hia doubt or indifference, 

Thus, the listeners' judgments can be completely distributed among 
the three categories of like, indifference and dislike. For convenient 
comparisons of reactions to different stimuli, it ia desirable to express the 
three percentages in one combined score. Two such combined scores 
have been used. The problem of this investigation ia to detormino the 
relative merits of the two scores aa applied to the attitudes of groups of 
listeners responding to various radio programs.' 

The Two Scores 

A. The ID-jcore. The customary technique of combining the three 
reactions into one score is to assign relative weights to each reaction and 
sum the resultant products. One way of doing this ia to subtract percent¬ 
age dislike from percentage like. Minus signs can be eliminated by 
assigning weights of 2 for like, 1 for indifference, and 0 for dislike. Either 
method yields the same result, We will refer to this score as the Like- 
miuus-DiBlike score, or for convenience, as the LD-score. 

B. The S-score. LazarsfeJd and Robinson ^ have proposed another 
technique of combining the three teactione into one score, which ia easen- 
tially a sigma score, and can therefore be called an S-score. It ia based 
on three assumptions: 

‘ j411 data were obtained witli the use of tho Lnzarsfold-Stauton program analyzer 
technique ng used by the Progrom Analysis Division of tho Columbia Drondenating 
System. In this techniquei the listener is naked to express his attitudes throughout a 
broEidcasb by prasaing a green button when he Ukea what ho is liatoning to, a red button 
when he dislikes it, and neiUwr button when he ia indiHorent, Tl\e piessing of tho 
buttons is automatically locorded on a moving tape. For a more dotniled description 
of the program onalyzer, aee the article by T. Hallouquist and E, Siicliman in Radio Re- 
seaTch 19:iS-1943 edited by F. F. Lozarafold and F. Stanton, pp. 266-334. 

^Laznrsfeld, P. F., and Hobinson, W. S. Some properties of the trichotomy “like, 
no opinion, dialike" and their psychological interpretation. iSocioiiieirj/, 1940,3,151--178, 
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1. Reactions to a stimulus are quantitative and in a continuous seHes. 
Three types of reaction are obtained because of the limitation of the in¬ 
structions given to tlie subject. But it is safe to assume that different 
degrees of feeling are expressed at different times within the same category 
of reaction. This ia borne out by the comments made when the subjects 
talk about a program to which they have reacted. 

2. Reactions are normally distributed. Since intensity of reactions is 
not measured, this assumption cannot be tested directly. However, the 
normal distribution remains a useful assumption, especially since it ia 
unlikely that the distribution of reactions to a radio program ever assumes 
the shape of a J-curve. 

3. A point of true neutrality'exists within the indifference range. This 
assumption is really a specific aspect of the first two assumptions. Since 
it ia assumed that there is a gradient of reactions ranging from extreme 
dislike to extreme like, there must be some point between these two ex¬ 
tremes of true indifference or neutrality. The most likely point of neu¬ 
trality seems to lie somewhere in the middle of the indifference range. 
Lazarsfeld and Robinson present some empirical evidence to support this 
assumption.* 

The S-score itself is the distance on the base line between the neutrality 
point (the middle of the indifference range) to the average of the distribu¬ 
tion, expressed in. sigma units. The method of its computation is de¬ 
scribed in the previously cited article by Lazarsfeld and Robinson. 

There are two apparent advantages of the S-score over the LD-score: 
(1) Standard deviation units are definite statistical terms with known 
meaning, whereas LD units arc difficult to interpret. (2) Standard devi¬ 
ation units are equal, whereas LD units are not. 

The Method 

In order to study the relative merite of the S- and LD-scorea for entire 
programs, the percentages of like, indifference and dislike were obtained 
for 53 different radio programs, representing a variety of program types. 
The number of subjects listening to a program varied from 49 to 116, with 
an average of 67. 

The S- and LD-scorea were compared for the total ratings of the 53 
programs, They were also compared for program parts within three 
programs: one which was highly liked, one highly disliked, and one to 
which most reactions were indifference. 

* The assumption of a neutrality point is not nec^arily required -when it is noted that 
the S-,score can also be viewed as the distance of dislike in sigma units subtracted from 
the distance of like in sigma units. This method of calculation will yield a score exactly 
twice the size of the S-scoro, 
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The S- and LD-acorea and the percentages of like, indifference and 
dislike for each of the three progrnma, and for the average of the 63 pro¬ 
grams, are presented in Table 1. 


Table 1 

ReiLctiouB to Rfvdio Programs 


Radio 

Programs 

Scores 

Porcantagos 


No. of 
Subjects 

S 

LD 

Like 

Indif, Dislike 

Liked 

1,00 

.02 

00 

24 

7 

70 

Indifferent 

.60 

.28 

37 

64 

0 

116 

Disliked 

-.03 

.02 

25 

48 

27 

50 

Average of S3 

.08 

.40 

40 

43 

0 

3650 


It can be seen from this table that “liked," “disliked" and “indifferent" 
programs are relative torma. Generally more reactions tended toward 
like than toward dislike, which, is not unexpected since the programs are 
designed for entertainment. However, analyses of oral interviews of 
listeners to these programs confirm the designations obtained statistically. 

Hesults 

A. Relation between the S- and LD-^scorea. Table 2 presents correla¬ 
tions between the S- and LD-scorcs for total ratings in 53 programs and 
for ratings within three programs.* 

Tabl©2 

Correlations between S- and LD-Scores 


Correlations 


Total Scores of 53 Programs 

.97 ■ 

Program Parts 

Liked Program 

.03 

Indifferent Program 

.79 

Disliked PcogTam 

.09 


With the exception of the indifferent program, it is apparent that the 
S-score and the LD-soote are bo highly correlated with each other that the 
use of either score will result in approximately the same rankings of 
programs or of program parts. • The high correlations further suggest that 
the data would be interpreted in much the same way whether the S- or the 
LD-scorea were used. 

* In all cases, correlations for the total ratings of the 63 programs are Pearson product- 
moment, and for program parts are rank-difference. 
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Profile cherts (not shown in this report) of S- and LD-scorea for pro¬ 
gram parts within the three programs show graphically the high relation¬ 
ship between the two scores. However, it ia interesting that at the begin¬ 
ning and end of programs, and during applause and transition passages, 
where the percentage of like and. dislike usually decreases, the LD-score 
tends to come closer to the base line than does the S-acore. From this 
one may conclude that the LD-acore reflects increased "indifference” 
more readily than the S-score. 

B. Relations bctwem the Two Scores and Percentage Like, Dislike and 
Indifference. Table 3 presents the correlations between the S- and LD- 


Table 3 

Correlations between Two Scores and Like, Indifference and Dislike 



Total Scores 


Program Parts 



63 

Programa 

Liked 

Program 

Indifferent 

Program 

Disliked 

Program 

S-L 

.87 

.86 

.42 

.68 

3-1 

-.62 

-.78 

-.09 

-.32 

S-D 

-.80 

-.27 

-.64 

-.80 

LD-L 

.96 

.97 

.89 

.74 

LD-I 

-.80 

-.01 

-.66 

-.37 

LDD 

Minim UZQ 

-.60 

.01 

-.17 

-.79 

SigniflcbDt 

Correlation 

.33 

,39 

.42 

.46 


scores and the percentage of like (L), indifference (I) and dislike (D) for 
the total scores of 53 programs and for parts within three programs. 

From this table it is apparent that the S- and LD-scores correlate very 
much in the same way with the percentages of like, indifference and dis¬ 
like. However, the three reactions have a more equal weight in the 8- 
than in the LD-score. This seems to belihe case since the correlations for 
total scores and for program parts between the three reactions and the 
S-acores are more equal in size than for the LD-score. 

Another, significant difference between the two scores ia that the 
S-score seems to give greater weight to dislike than does the LD-score. 
The LD-soore gives the greatest weight to like, the predominant reaction, 
C. The Reactions of “Indiffer&nl'* Subjects. A further comparison of 
the two combined scores can be obtained by examining the '‘indifierence" 
reactions, One approach to this problem was to examine the reactions 
of the most indifferent subjects in various programs. This analysis will 
yield some information concerning sustained indifference at least. Those 
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subjects who pressed cither red or greeij buttons less than one-half of tile 
program time were arbitrarily classified as "indilferent'’ subjects, For 
eleven different programs, the indifferent group averaged 37 per cent of 
all subjects. 

The general attitude of the subjects to a program was aaccYlaincd by 
their answer to a standard question: 

In order to get you to listen to future brondcaata in this series, should the 
programs be; very much like this one, improved a bit, or improved a good deal? 

Those who checked 'Very much like this one” have been designated Satis¬ 
fied listeners; those who checked "improved a bit,” Conditional listeners; 
and those who checked "improved a good deal," Di-ssatisfied listeners. 
This question lias been found to correlate very highly with analyzer 
reactions and with the tenor of the comments made by listeners in group 
interviews after each program. 

In eleven different programs, it was found that 27 per cent of the 
Satisfied listeners, 40 per cent of the Conditional listeners, and 55 per cent 
of the Dissatisfied listeners were "indifferent,” This indicates that the 
"indifferent” listeners tend to be more dissatisfied with a radio program 
than the "non-itidifferent” listeners. 

One cannot conclude from these finding that "indifference'' is always 
a negative reaction. “Indifference” may express an intermediate state 
between like and dislike. It may express anticipation or relaxation, as at 
the beginning of a program or in transition passages. However, it is clear 
that some so-called “indifference” reactions are really negative, This 
seems to be true of much of the sustained indifference. The S-soore, 
therefore, seems to be superior to the LD-scoie, for radio programs at 
least, since it givfes more weight to dislike and in that way, scorns to take 
into account that part of indifference which is really negative. 

Summary and Conclusions 

The overwhelming conclusion from these data is that the S- and 
LD-scores yield virtually the same results and compel virtually the same 
interpretations of listeners' responses to radio programs. This conclusion 
supports the earlier investigation of Likert ® in which he demonstrated 
that sigma scaling of attitude questions are no more reliable or discrimi¬ 
nating than a scoring of 1, 2, 3, 4 and 5 for the five alternate answers. 
Despite this conclusion, there are certain other considerations which 
militate in. favor of the S-acore: 

' Likert, R. A technique for the meftsuiement of attitudes. Archives oj Psychology, 
1032, No. 140. 
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1, Ths S-score reflects all three reactions mors eguitally than the W- 
score. The LD-score gives the greatest weight to the predominant reac¬ 
tion, which in the case of radio programs is like. The S-score gives more 
even weight to all reactions, which in the case of reactions to radio pro¬ 
grams, gives more weight to dislilce, Such additional weight seems to be 
justified since it is highly likely that in a situation which is positively 
toned, any degree of dislike may have more significance than is indicated 
by a percentage, In addition, since it has been shown that some of the 
'‘indifference" reactions are really negative, dislike should be given more 
weight. 

2, Tk trend oj ik S-score is mmimd in periods of ‘kiijjerence.'^ 
The S-score does not drop os much aa the LD-score at the opening and 
close of the program and during transition passages. The trend of the 
S-score seems to be more justified than the trend of the LD-scoie at such 
points because these are not really periods of indifference, Analysis of 
listeners' attitudes during these periods reveals that the listener is not 
indifferent; ho is waiting for something to happen. During transition 
passages and at the end of the program, the listener’s attitude is one of 
relaxation rather than indifiereuce. 

3, Tk S-score mils an equal whereas ik LD-score rfs are not. 
Equality of units permits direct comparison of reactions to programs and 
to program parts, 

Received April 18,19^. 
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Luckiesh, M. Light, vision and seeing. New York: D. Van Noebrand Co., 

1944. Pi). 323. S4.60. 

In this treatise Dr, Luckicah gives a simplified presentation of tho reltvtion- 
ships of light, brightneaa, vision, lighting and seeing. An attempt has been 
made to combine fundamental facts with practical discussiona. The material 
is aimed to be helpful to those inieTeated in better seeing conditions and their 
effects upon human efficiency and welfare. Tho book ia dedicated to "Better 
Ligh^-Better Sight," a slogan employed by the ligjliting industry. 

This book will make a strong appeal to tho uncritical reader or to the unin¬ 
formed reader. It ie of considerable importance, therefore, to examine the 
material in some detail. First, however, let us note some of the contributions 
which should receive unequivocal approval: (1) The material is clearly presented 
in relatively flimplo language. (2) The author makes a strong case for the 
maintenance of hygienic conditiona for seeing. (3) Dcsiroblo emphasis ia 
placed upon the relation of brightacaa and brightnesa contrnat to visibility and 
to ease of seeing. (4) An important place ia rightly given to the interd^psu- 
dence of the four fundamental factors (size, contrast, brightness, and time)_ that 
determine the visibility of objecta. (5) The meaBUTement of visual acuity ia 
adequately handled. (6) One of the beat sections deala with alternation of 
brightnesses and glare in the visual field in relation to efficiency and case of 
aeeirig, (7) The section on light and color is practical and is effectively done. 

Analysis of the diacusBions suggests the following criticiama to the reviewer: 
(1) The author consistently ignores the fact that the eyes readily adapt to easy 
and effective seeing over a wide range of illumination intensitieB. Emphasis is 
given only to the adaptation for effective vision at the higher levels. (2) The 
diBrnisBlng of findiivga condictlng with the author’s views by means of ridicule 
rather than on the basis of sound criticism is both ineffective and a sign of 
weakness. Thus we find employed such terms as "sheer nonsense," "tho valor 
of ignorance/' "gross ignorance," "ridiculous,” and "meaningleaB" to express 
the author’a reaction to the contributions of others. (3) Several decades of 
work in the field of vieion is no oriterion of infallibility. Furthermore, the 
recurring phrases "it is axiomatic” or these "facts are axiomatic” become un- 
convincmg, since in certain instances the critical reader will recognize that they 
arc neither facts nor axiomatic. (4) Relatively high intensities are required 
for adequate seeing where discrimination of details involves low brightness con¬ 
trast. It does not follow, however, that the same high intenflitiea are necesBary 
in the large majority of everyday visual situations. This distinction is not 
made clear. (5) In conaidering the fixational pause of the eyes, questionable 
da^ ore cited although adequate data are available in the literature. (6) In 
citing eye-movement time for reading (page 128), the record is decidedly atypi¬ 
cal or the computations are wrong. Duration of the back sweep and other iuter- 
fixation movements are far too long. (7) It is stated that 11 point type is far 
above the average typography commonly encountered. Thia is misleading 
since actual figures show that journals and books arc typically printed in 10, 
11 or 12 point type. (8) The author's attitude toward rate of reading aa an 
indicator of ease of seeing is highly inconsistent. Thus; (a) "It is axiomatic 
that if very poor seeing conditions are improved . . . quantity of useful work 
done should improve." (t) "As a criterion of optimum levela of illumination 
. . . rate of performance of a visual task is inadequate.” (c) Nevertheless 
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speed of reading ia employed to measure influence of brightncGa contrast between 
print and background, (d) best, speed of reading is' an insensitive cri- 
terioa" of ease of reading, (e) But the author employs eye-movement meas¬ 
ures (perception time, fixation frequency, pause duration, regressioQ frequency) 
in reading to show the effect of variation in level of illumination. He concludes 
that the effects of fatigue are obviously greater for the low level of illumination 
as is evidenced by the change in eye-movement measures. Apparently the 
author does not realize that eye-movement measures are merely measures of 
speed of reading. It seema that rate of perception (reading) is accepted as a 
criterion of ease of seeing only in Bituatione where the results support his views. 
(9) To measure case of seeing the author usually obtains results for one versus 
100 foot-candles, or one versus 10 versus 100 foot-candles. It is obvious 
that, in any visual situation, where discrimination ia concerned, one may expect 
improvement in visual efficiency in going from one to 100 foot-candles, or even 
from one to 10. And where diBorimination ia severe improvement is probable 
from 10 to 100 foot-candles. Luckiesh himself suggests that, to obtain a 
significant improvement ip seeing,’ one should double the foot-eandle level, 
He also states that one is generally more concerned with the practical optimum 
(level of illumination) than with the absolute maximum for many ordinary 
tasks. It is pertinant to ask, therefore, why he does not employ in hia studies 
1, 2, 4, fi, 16, 32, 64 and 128 foot-candles rather than only 1 versus 100, or 1 
versus 10 versus 100. Resnonges at various levels from 10 to 100 foot-candles 
have not been investigated. Possibly the rate of change in efficiency is ex¬ 
tremely slow from 16 or 20 to 100 foot-candles. In the majority of visual situa¬ 
tions which Involve details considerably above the visual threshold in size, we 
are interested in knowing the level of illumination above which no practical 
gains in efficiency occur. This cannot be revealed by, Luckissh's data. (10) 
The use of heart rate, the blink technique and visibility measurements ag 
criteria of ease of seeing have been criticized in another paper.^ An additional 
comment may be made. The reliability of blink scores for a five minute period 
of reeding is low ( + .49). Also one may question the stability of some differ¬ 
ences obtained. For example, Memphis medium type ia called easier to read 
than Memphis bold because 7 per cent more blinks occur with the bold in five 
minutes of reading. About 25 blinks occur in five minutes, Thus the bold 
would be read with 1.6 more blinks per period, With only 18 to 40 Bubjects, 
is this a stable difference? (11) The author delights in setting up straw men 
so that they may be knocked down. Thus he implies that someone has stated 
that 10 foot-candles is enough for any kind of reading—which has not been done. 
Then he points out the need for relatively high intensities needed for people 
with eye disabilities and for reading very illegible type—to which no one 
objects. 

Dr. Luckiesh has written an interesting and important book, The treat¬ 
ment of several topics may be considered excellent. Much of value may be 
gained from the rest of the material if read critically. 

Miles A. Tinker 

Unmrsit]/ oj Minnesota 

^ Tinker, M. A. A reply to Dr. Luckieali. J. appl. Psyahol, 1043, 27, 469-472. 
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Intelligence and Adjustment Measurements in the Selection 
of Radio Tube Mounters 

George Forlano * and Forrest H. Kirkpatrick 

Radio Corporation of America BeiJuiny College 

The general problem with which thia study was concerned is the in¬ 
crease of worker efficiency in radio tube mounting jobs. Specifically the 
problem reduced to: will intelligence and adjustment tests be effective in 
bringing about this desired increase in efficiency? There have been many 
claims as to the effectiveness of adjustment testa in particular in the 
selection of more desirable workers, but there have been too few quantita¬ 
tive presentations of proof. Vague opinions of personnel officers that 
the use of tests brings superior employees are too often accepted without 
evidence. 

The subjects employed in this experiment were twenty female tube 
mounters in one department of the Indianapolis Plant of the Radio Cor¬ 
poration of America. Tube mounters assemble the very small tube ele¬ 
ments to the bases of radio tubes. It is very close work requiring con¬ 
siderable finger and hand dexterity. Several mounters, each performing 
distinct operations, work together on each tube. The subjects were new 
employees who had taken the required placement tests, and had been 
assigned as tube mounters. New employees were used in the experiment 
because it was desirable to keep all regular workers on the production line. 

The tests used for the purposes of this experiment were the (1) Otis 
Self-Administering Test of Mental Ability Form B, (2) the Bell Adjust¬ 
ment Inventory, adult form, and (3) the Washburne Social Adjustment 
Inventory. Of the latter two tests only the scores which are designed to 
measure social adjustment were used. This included the "social” score 
of the Bell test and the “alienation” score of the Washburne test. These 
were administered before the employees started work. The subjects also 
took the regular aptitude battery (a vision test, ft two-hand coordination 
test, and manual dexterity tests) with which we shall not concern ourselves 
in this report. 

* Now in tho U. S. Anny. 
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The criterion used for this experiment was ratings by the supervisor in 
charge of the group. Each worker was rated for the extent to wliich she 
took hold of the job and performed efficiently. The.sc ratings were given 
on the basis of one month's observation of the worker tit licr task. The 
supervisor's ratings were in the following terms; G, indicating a good 
employee; and F, indicating a fair employee. 

For purposes of examination of the data, teat score distributions were 
divided into three groups and scores within the groups assigned the values: 
above average, average, or below avemge. Table 1 gives the groupings 


Table 1 

Diatiibution of Test Score Values to Various Groupings 


Teat 



Grouping 


Above Avei'ftge 

Averagu 

Below Average 

Otis Mental Ability (I.Q.) 

115 and over 

05 to 114 

94 and below 

Bell Social Scores 


5 to8 

0 to 10 

20 to 24 

Washburno Alienation Scores 

0 to 5 

0 to 15 

10 and above 



Table 2 




Showing Mounters' Testa and Related Data 






Composite 





Inleliigenco 

Tube 

Supervisor’s 

Otis 

Personality 

ana 

Mounter 

Ratings 

I.Q.'b 

Rating 

Personality 

1. 

Q 

125 

+av. 

12 

2. 

P 

122 

-av. 

6 

3. 

G 

122 

av. 

0 

4. 

G 

122 

+av. 

12 

6. 

F 

118 

— av. 

6 

0. 

G 

118 

av. 


7. 

F 

118 

av. 

0 

8. 

F 

114 

— av. 

3 

9. 

G 

111 

+av. 


10. 

F 

101 

—av. 

3 

11. 

G 

08 

av. 

G 

12. 

G 

97 

+av. 


13. 

F 

95 

av. 

0 

14. 

F 

01 

av. 

3 

16, 

F 

80 

— av. 


10. 

F 

78 

—av. 


17. 

F 

70 

av. 

3 

18. 

F 

72 

— av. 


19. 

G 

69 

av. 

3 

20. 

F 

95 

av. 

3 
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uaed. These divisions were baaed on distribution of scores into upper, 
middle, and lower thirds. 

The two personality test scores were then combined in such a way that 
if a worker made above average on both testa she wag rated “+ average” 
for personality; if she received above average on one test and below on 
the other, or if she wos average on both, she was rated "average” in per¬ 
sonality. Likewise, if the worker made below average on both tests she 
was rated " — average’* in personality. These are the figures shown in 
Table 2 under the heading "Personality Rating.” 

Table 2 also shows a column headed “Composite Intelligence and 
Personality.” These figures were obtained by weighting an above average 
pefsona/ifcy r&t'mg or Otis score as 6, ao average rating or score as S, and 
a below average rating or score as 0, and then adding the two weights for 
each peiBon. Hence, the composite could range from 0 (below average 
Otis score + below average personality rating) to 12 (above average 
Otis score + above average personality rating). Table 2, then, contains 
the basic figures from which experimental results were studied. 

Intelligence and Job Success 

Table 3 shows the relationship of intelligence test scores to the ratings 
of job success. For employees with average and above average scores 
there were exactly the same number rated “good*' by supervisors as there 

Table 3 


Dislribiitionf' of Intelligence Test Score# for "Good" and "Pair" Employees 


Test Score# 

Kilted "Good" 

Rated "Fair" 


Above Averftgo 

3 

3 


Average 

3 

3 


Below Average 

1 

6 



Were rated "fair.” However, 6 out of 7 who were below average in intelli¬ 
gence had been rated as “fan*” by the supervisor. It would seem from these 
results that low intelligence would go with poor job success while above 
average intelligence does not give advantage over average. This might 
have been expected since, although it tolces a certain amount of intelli¬ 
gence to learn the job, there is not much to tax mental capacity after it is 
l(3arned. 

Social Adjustment and Job Succeas 

Table 4 summarizes the relationship between personality test scores 
for social adjustment and ratings of job success. The scale indicating 
“social adjustment” here is the combination of Bell and Washbume scores 
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given under "Personality Rating” in Table 2. These lesults are rather 
striking in that all of the people scoring above average on the testa also 
were rate^l "good” by their supervisor, while all of the people scoring below 
average on the tests were rated "fair” by the supervisors. Whether this 

Table 4 


Diatributions of Personality Hatingp for "Good” niid "Fair’' Employees 


Teat ScoTCsa 

Haled "Good” 

Hated "Faic” 

Above Average 

4 

0 

Average 

4 

5 

Below Average 

0 

7 


indicates that a socially adjusted peraonnlity ia an important factor in 
doing good work, or that the supervisor was more influenced by the girls’ 
"personalities” than their performance, is uncertain. Certainly the testa 
were measuring something which was related to the aupcrviaor’g notion of 
good and fair employee risks. 

Job Succeaa and the Compoaitc Score 

When the intelligence and personality scores are combined in the 
manner indicated in Table 1, distinction between "good” and "fair” em- 
ployeea ia apparent. Table 5 shows that by eliminating all the employees 


Table 6 

Composite latelligenco and PetBonality Score Diatributiona for 
"Good” and “Fair” Workers 


Compoaite Score 

Rated "Good” 

Rated "Fair” 

12 

2 

0 

g 

4 

1 

6 

1 

4 

3 

1 

6 

0 

0 

3 


who had a composite score of 3 or leaa, we would have left 88% of the 
"good” employees and only 39% of the "fair" employees. 

Moreover, by eliminating emplpyees whose composite scores are 6 or 
leas, all but one, or. 92%, of "fair” employees would be eliminated. At 
the same time only 2, or 25%, of "good” employees would be lost. It 
would seem from these figures that, in times of a favorable labor market, 
these testa would be very effective in selecting workers able to meet with 
the approval of supervisors. 
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Summary 

This study was ooncernGcl with the effectiveness of certain personality 
and intelligence measures in predicting the job success of 20 tube mount¬ 
ers. Relationships were shown between supervisory ratings of i ob success 
and scores on the Otis Self-Administering Test of Mental Ability, Form 
B, the social scale of the Bell Adjustment Inventory, and the alienation 
scale of the Washburne Social Adjustment Inventory. The following 
conclusions wore drawn: 

(1) Low intelligence scores tended to indicate the poorer workers, 
Average or above average scores did not discriminate between "good" 
and "fair” workers. 

(2) All workers scoring below average in social adjustment had been 
rated only "fair" by the supervisor while all woikers scoring above 
average in social adjustment had been rated "good" by the supervisor. 
The supervisor had no previous knowledge of test scores. 

(3) A composite of intelligence and personality scores was shown to 
be effective in predicting the Biibsequent success of new tube mounters. 


Received July 19^. 



Single-Item Tests for Psychometric Screening * 

Lieut. H. Ml. Hildfetli, UST^R 

A series of 10 Single-Item Tests are presented in this article. These 
tests, designed for psychometric screening, were developed at a Naval 
training station in response to the need for rapid inetliods of examining 
the iatelligence of large numbers of recruits. They take from 1 to 2 
minutes per man to admiuiatet, and do not require optimal testing condi¬ 
tions. Standardized on 1,500 caaes they have also been tested in actual 
practice and found to be practicable. In a S-month trial period, during 
which the teats were used as a basis for accepting recruits for service, the 
error involved was found to be less than 1/10 of 1 per cent. 

A New Approach to the Problem of Screening 

Single-Item Testa are the result of a new approach to the aoreeiimg 
problem of increasing speed of. testing without losing accuracy. The 
usual approach has consisted of abbreviating, and devising short forms of, 
standard mental teats. These short forms bring testing time down from 
an hour to around 10 or 16 minutes, without appreciable loss of accuracy; 
but this is about the limit to which stondard-type tests can be skeletonized 
without sacrificing reliability. 

The reason for the limitation of this approach lies in the psychometric 
requirements imposed by the purpose of mental measurement. lu the 
past this purpose has always been to determine the true or maximum 
mental ability of the individual Standard tests, including those recently 
streamlined for screening, have always been designed and constructed to 
tneasure this maximum. 

In psychometric screening the mdividuaPa maximum is not a matter of 
concern. The purpose in screening is to make sure that a recruit’e mental 
ability is not below a given minmum and that he ia thereby acceptable for 
naval or military service. Testa for acceptance need measure only thia 
minimum; it is not necessary to meosUTG maximum ability. 

Recognition of this basic difference in purpose makes it possible to 
dispense with 3 traditional psychometric requirements. In tests for 
maximum ability; (1) many items are ordinarily included in the test so 
that the individual will have ample opportunity to demonstrate hia full 

* The opinions or assertions contained in this articlB are the private ones of the writer 
and are not to be conatrued aa ofEoial or reflsoting the views of the Navy Department 
or the Naval Service at large. 
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ability) (2) failure is accorded as much significance as success, since the 
failure level of an individual must be determined if his maximum per¬ 
formance is to be knov'n; and (3) scoring of failure requires in turn that 
maximum-ability tests be administered under optimal testing conditions. 
Unlike success, which demonstrates the presence of ability, failure does 
not necessarily indicate lack of ability. It may be due to distraction, 
confusion or anxiety, and until these and similar extraneous causes are 
eliminated, failure cannot be taken to mean “lack of ability." 

In testing for minimal mental ability none of these requirements need 
be considered. One success is sufficient to establish a minimum. A re¬ 
cruit who is successful on a single item demonstrates he has at least the 
degree of mental ability called for by that item. He may well have more, 
but it is certain he does not have less. If the measuring power of the 
particular item has been determined, then a minimal mental ability can be 
ascribed to the man at once and without further testing. 

Ordinarily, however, only the average difficulty of test items is known, 
The minimal mental ability which they represent is not known. To ob¬ 
tain this information, and make possible the use of single items as screen 
tests, the special scoring technique described below was devised. 

Scoring Technique 

The technique used in scoring items for screening consists of tabulating 
for a normal group the mental ages of all those who are successful on a 
given item, and then determining the point at which this distribution 
becomes asymptotic to the mental-age base line. Those items found to 
represent a minimal mental ability of the desired degree are suitable as 
screen tests. 

The desired minimum in the present case was 11 years, or 132 months, 
mental age, the minimal mental ability for Naval service originally set by 
official directives, Thirty items from well-known teats (1, 2, 3) were 
selected for scoring. In conjunction with a Stanford-Binet examination 
these 30 items were administered under optimal conditions to 1,500 men of 
military age. Care was taken to assure a normal distribution in respect 
to mental age, particularly in the lower brackets. 

Each of the 30 experimental items was then scored for minimal mental 
ability. (1) A frequency distribution was made of the mental ages of all 
those who passed the given item. Failure were disregarded. (2) The 
point at which the distribution approached zero was located. For pr.icti- 

‘ The foregoing opplica to freo-reaponBO items such os those used in the S-I Teste. 
Success cannot be considered prima facie evidence of ability in multiplo-choice or true- 
false items where an appreciable clement of chance is present. Coaching, of course, 
Invalidatea any mental test. 
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celI purposes this point woia set at the first percentile, with the one-half 
percentile point also being computed. (3) The mental ages correspond¬ 
ing to these points were determined. If the mental age nt the first 
percentile wag 132 months or greater, the item was con.sidercd suitable as 
a Single-Item Teat for acreening. 

In the “Squares" problem below, for example, all individuals in the 
fitandardization group passing the item were geparated out and their 
mental ages were tabulated in a frequency distribution. The first per¬ 
centile of this distribution was computed and found to bo 132 months. 
Since this value was not below the desired minimum, the item was con¬ 
sidered suitable as S-I Test. The chances are less than 1 in 100 tliat a 
recruit who passes this test during screening will have a mental age below 
132 months. 

Of the 30 experimental items scored in this manner 10 were found to 
guarantee mental ability above the Navy minimum. These 10, desig¬ 
nated as Single-Item Teats, are described below.* 


Description of Single-Item Tests 

In the column headed P = .Q90 is listed (in months) the mental age 
value at the first percentile. The probability « .09 that an individual 
passing the S-I Test will have a mental age at or above tliat listed in the 
table. Tor column P * .995 the chances are 190 in 200 that the indi¬ 
vidual will not be below the mental age listed there. These probabilities 
are in terms of a normally distributed male group of military age, as found 
at an induction center. This is the group customarily dealt with in 
screening.* 

Scoring of the Kent and Stanford-Binet items is in most instances 
identical with that originally described for these items. 


1. Question: 

7 times 7 
S times 8 
9 times 9 


“How much is: 

10 times 10 

11 times 11 

12 times 12 



Scoring; Pass if subject makes no more than two errors. 



^ It will be noted that some of the values in this tablo aro below 132 months, but not 
below 126. It has been found in proctico that 126 is a safe value to use bccauso of the 
conditions under which Bccccniag is uaually doao, and because StRatovd-Biuol scores on 
subnormals tend to run somewhat lower than the Wcchsler-Bellovuc (4) which is fre¬ 
quently uacd for dotcTmiiunE mental age. Scoring of WcchBlcr-BoUevuo items for ecreen- 
ing is now under way. 

’ When testing is limited to doubtful coses oU of ■whom are suapeoted of mental 
deficiency success may be conservatively interpreted in terms of this group, The 
probability is less than .05 that an individual whose mental age is below 11 years will 
pass any given S-I Teat. The null-type hypothesis that the individual is dofeotivo is 
then disproved by his success. 
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2 . Question; “What does the word PRICELESS mean? 133 126 

Scoring; Full credit for such respooses as “very valu¬ 
able/' “you can't buy it for any amount of money," 

“it ia worth a lot." If the subject says “It has no 
price," aak what he mcana. Make sure ho really 
knows tho meaning of the word. 

3. Question; “If your shadow points toward the north¬ 
east, in which direction is the sun?” 134 128 

Scoring: Credit if response Is “Southwest.” 

4. Question: “Wliatdocs the word TOLERATE mean?” 142 139 

Scoring: Full credit for such responses as “it means to 

put up with things,” “it means you stand for what 

f icople do without getting mad,” “it means to be 
eniect," “to endure," Do not credit such re¬ 
sponses as “I tolerate you” unless the subject can 
follow with a clear explanation. Do not credit such 
responses as “it's a sickness—the cholcry." 

5. Question: “What is the next number?” 

1 2 4 8 13 — 139 137 

These numbers arc presented in written form. 

If subject hesitates, say “These numbers go up in a cer¬ 
tain order; what would be the next one?” 

Scoring: Credit only if the subject says “32” and is able 
to explain that the numbers are being doubled. 

6. Question; “Why does the moon look bigger than the 

“Whot time of day is yourshadow shortest?” 136 132 

Scoring: Full credit if both questions are answered 
correctly. 

For the first question credit eueh responsea os “the moon 
is closer (nearer) to the earth,” “the stars are farther 
away," No credit for such answers aa “the moon is 
bigger"; give assurance that the moon is really 
smaller, and repeat the question. 

For the second question, credit “noon” or any time be¬ 
tween 11:00 and 1:00. No credit for “night” or 
"4 o’clock." 

7. Question: “What is the opposite of WINTER?” 

“What is the opposite of WAR?” “What is the 
* opposite of BROAD?” “Whot is the opposite of 136 129 

ALIKE?" “What is the opposite of DEEP?" 

Scoring: Full credit if subjeot can ^ve the opposite of 
four of these words, 

8. Question; “Make a good sentence out of these 

words." 129 126 

FOR THE STARTED AN WE COUNTRY 
EARLY AT HOUR 

These are presented to the subject in written form. 

Scoring: Full credit for “wc started for the country at 
an early hour," “nt an early hour wc started for the 
the country," “We started at an early hour for the 
country," 

9. Question: “What does the word MARS mean?" 

“What does the word HYSTERICS mean?" 130 127 

“What does the word BRUNETTE mean?" 
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Scoring: Pasa the subject if the meaning of caoh of the 
words can be given. 

For MARS give credit for "planet” or "the God of War.” 

No credit for "it is up in the sky,” “it ia a place," 

"it is a country,” "it ia a candy bar.” 

For HYSTERICS give credit for "it is nervous sick¬ 
ness,” "it 13 like having a fit of crying," “to get 
excited and go all to pieces.” No credit for "it ia 
about old times” (historic). 

For BRUNETTE give credit for "dark complexion,” 

"black hair,” "a person who ia dark.” No credit 
for "a blonde," "it ia ft woman,” "red hair.” 

10. Question: "In what way are a KNIFE-BLADE, 

a PENNY, and a PIECE OF WIRE alike?” 120 120 

Scoring: Full credit if response ia "metal." No credit 
for "copper,” "eteel,” "they are useful,” or "they're 
all hard.” 

p = .990 P = .995 
Use of S-I Testa in Screening 

Each of the 10 S-I Tests above is an independent test of acceptance. 
Success on any one of the tests demonstrates mental ability above the 
minimum for Naval training.^ No attention need be given to providing 
optimal testing conditions. A distracting situation does not invalidate 
an S-I Teat; on the contrary it increases the significance of the recruit's 
success. When privacy is not available and the replies of one man can 
be overheard by those next in line, the tests can be used in rotation, each 
man receiving a different question. 

The majority of men pass the first test given them promptly. Failure 
on any or all of the S-I Tests, however, does not mean that a recruit is 
necessarily below the required mental minimum. Confusion rather than 
lack of ability may cause the failure. If the recruit is unauoceasful in 
several triea, he should be held over for furthei’ examination, 

This aubsequent examination may include more elaborate phases of 
acceptance testing (5). It may also involve testing for rejection with 
the usual full-length psychological tests. These "many-item” teats, de¬ 
signed to measure maximum intelligence, are necessary before a decision 
to rej ect can be made, and the more hours available for thorough rej eotion- 
testing of this group the more men can be salvaged for service. Single- 
Item Teats, by speeding up acceptance, save time for the more careful 
examination of these borderline coses. 

* Preaont data indicate that when testing is continued until 2 S-I Testa are passed, 
3 montliB may be added to each of the lower values. E.g. if the first and second testa 
are passed the new miniiral values would be 136 and 129 for the 2 degrees of probability. 
In some coses, but not all, this will establish a higher minimum than that given for either 
of the 2 tests, 
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Single-Item Tests for Psyckometnc Screening 
Summary 

Ten Single-Item Testa for use in psychometric screening are described. 
These teats, the result of a new approach to the problem of screening, 
require 1 to 2 minutes per man to administer. Success on any one of them 
denotes mental ability above the minimum required for Naval training. 

S-I Tests for rapid acceptance allow more time for rejection-testing of 
borderline cases, many of whom can be salvaged when additional examin¬ 
ing time is available. 

ReceividJuly S, 19^. 
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Range of Interests * 
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Everyday observation and clinical experience suggest that the well 
adjusted individual has a wide range of inteteata and that other individuals 
who are experiencing conflicts within themselves and with their gocinl 
environments tend to have more restricted ranges of interests. Nar¬ 
cissism QccompameB many psycholo^cal malfunctions, and inability to 
attend to and maintain interest in occupational and extra-vocational 
activities often characterizes the neurotic adult. Extreme egocentricism 
is normal in infants and very small children. In physically mature 
individuals it indicates a lack of personality development or a regression 
resulting from various psychological frustrations. This regression may 
be as complete as that we observe in the advanced case of schizophrenia, 
or it may be more subtle. 

Experience again suggests that the ranges of interests possessed by 
normal persona may vary widely and that some otherwise abnormal per¬ 
sons may have interests that do not differentiate them from normal 
people. A suspicion is justified that a few abnormal persons might have 
unusually wide ranges of interests and that this extensifcy of interest may 
or may not be related to their abnormality. 

Very little relevant, systematic information is available regarding this 
problem of the relationship between the range of interests and other 
psychological attributes. The range of interests, as measured by the 
number of items marked as liked or disliked on the Strong Vocational 
Interest Blank, was found in one study * to be slightly correlated with 
high school and college grades and morale and social adjustment scores 
of the Minnesota Personality Scale. These correlations, ranging from 
—.18 to +.23 and determined on a sample of 411 college freshmen, were 
statistically significant but were too small to be of any value in predicting 
adjustment. The items liked on the Strong test are determined to a far 
greater extent by the person's vocational interest profile than by his 
personal adjustment, That is why the items were selected. The rela- 

* The opinioTifl or assertionB contained hetdn are tho private ones oC tho writer and 
are not to be construed as official or reflcisting tho views of tho Navy Dopartraont or tho 
Naval Service at large, 

1 Berdio, R, P. Likes, dislikes, and vocational intereata. J. appl. Paychol, 1943, 
27, lBO-186. 
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tionship fo\ind between range of interests and adjustment, however, sug¬ 
gests that items selected with the purpose of predicting adjustment rather 
than differentiating vocational interests might have a greater prognostic 
value. 

The problem of predicting personal adjustment is particularly im¬ 
portant to military psychologists attempting to eliminate those misfits 
from the service who, if allowed to remain, will eventually break down so 
as to endanger thcmaclvcs and their fellows and shoulder the government 
with rehabilitation and pension costs. 

Each man entering military service passes through at least one psy¬ 
chiatric screening, The type of screening depends on the available staff, 
the time allowed, and the facilities at hand, but in each case an attempt is 
made to determine if the man presents an adequate military risk or not. 
The pressure of work requires that the psychiatric screening be quick and 
even in those places where time for more extensive study is available, 
complete personality studies are not feasible. 

Mental dcficioucy and illiteracy can be determined with relative eim- 
plioity. The frank psychotic, the organic deteriorate and the obvious 
misfit can be selected with but little more difficulty. Other cases, such 
as anxiety neurotics, hysterical personalities and constitutional psycho¬ 
pathic states, are more difficult to identify. 

The problem attacked in this study concerned the usefulness of the 
range of interests in selecting potential psychological misfits at the begin¬ 
ning of military training. Does the range of interests possessed by an 
individual bear a relationship to his military adjustment and can this 
range be adequately measured? Are criteria ovailable against which we 
can evaluate the predictive value of such a measure and finally, is such a 
measure useful in the military situation? 

The study is divided into two sections. The first concerns a list of 
interest items presented orally to recruits. Here are discussed the ques¬ 
tions of how stable the likes are from group to group, how the range of 
interests is related to ability and how well it differentiates between normal 
and abnormal recruits. 

The second section of the study concerns a list of interest items pre¬ 
sented in printed form to recruits. Here are discussed the questions of 
how reliably this list measures the range of interests, what the relationship 
between the range of interests, age, and education is, and how well it 
differentiates between normal and various groups of abnormal recruits. 

Orally Presented List 

A group of 31 activity interest items were pre-tested on a group of 
marine recruits and 22 of these items were liked by over 50 per cent of the 
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men. These 22 items were retained to form the interesb scale. The items 
are presented in Figure 1. 


- -Age-Platoon No.'- 

Highest school grado completed:-at-years of ago. 

Dirbctionbi Below is a list of things people do for recreation. Place a check 
(X) after the name of each thing you LIKE TO DO. After those things 
you dislike or have never done, leave a blank space. 

play checkers.-Pining................... - 

Play pool..Hiking... 

Play norseshoea,....Go to carnivals. . 

I)anc 0 ..Go on picnics. . 

Go on dates. .Reading.. 


Box. 

Play cards.... 
Go to parties.. 
Play baeketbaU 
Flay baseball - ■ 
Play football. . 


Go to movies. . 
Listen to radio. 
Roller skate. . . 
Watch baseball 
Watch football. 
Goawitnming.. 


Fiq. 1. Interest list presented to marine recruits immediately after physical oxamination. 


The items were then presented in individual interviews to 200 marine 
recruits selected at random at the completion of their physical examina¬ 
tion.'^ In the interview the examiner said, 

"I would like to find out what things you like to do. I will name these 
things to you and you tell me if you like to do them or not." 

The items were presented in the order they appear in Figure 1, the 
examiner saying, “Do you like to play cbeckers?'', “Do you like to go out 
on dates?", etc. With the last item, if the man said he was married, he 
was asked, ''Did you like to go out on dates before you were married?" 
If the recruit said he liked the activity or disliked it, the examiner recorded 
the response. If he said he did not know or had no contact with the 
activity, this was recorded as an “indifference” response. Some subjec¬ 
tive judgments were necessary in recording the responses but any state¬ 
ment connotating acceptance (“I like it sometimes”) was recorded as a 
“like.” 

The list of items was then presented to 68 marine recruits recom¬ 
mended by the psychiatric unit to the aptitude board for inaptitude dis¬ 
charges. These recruits were all literate and none were mental defectives. 

' The ropreseDtabiveness of this grot^ is evidonced by tho moan General Gkasliica- 
tlon Test sociie oC 101.8, BD * 16.S £oi 172 oi men for whom G.C.T. soorea were 
available. 
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Their difficulties included anxiety neurosesj hysterical states, epilepsy, 
enuresis, constitutional psychopathic statcSj post-traumatic syndromes, 
and psychaathenia. They were a very heterogeneous group of non- 
psychotic psychiatric eases, 

Each man had been interviewed at least twice by a psychiatrist and 
twice by a psychologist and psychological t^t scores and verified social 
histories were available for many. In each ease the decision had been 
made that their problems would prevent them from making an adequate 
military adjustment. These decisions \vere all made before the presenta¬ 
tion of the interest list. 

Two indices of range of interest were obtained from the responses to 
the items. The first consisted only of the number of items liked, The 
second was based upon weights assigned to each item upon the basis of 
the percentage of the number of cases liking the item. A man not liking 
to listen to the radio, an activity liked by 08 per cent of men, is more of a 
deviate than one who doesn't like to dance, an activity liked by only 53 
per cent of men. By weighting each response in direct proportion to the 
extent to which it indicated an individual was a deviate, we hoped to 
obtain a more differentiating score. The results showed that the scores 
based upon the weights gave no better differentiation than the scores 
consisting merely of the number of activities liked. 

Keaulta 

The stability of interests from group to group is important. Will 
interest items rank themselves in the same order of popularity in different 
samples or do conditions affecting the popularity of different activities 
vary from group to group to such an extent that interest in these activities 
cannot serve as a basis for constructing a scale for general use? Are there 
items which have a well defined place in the recreational hierarchy of adult 
males in America? 

The 22 items were ranked according to the proportion of the first 50 
subjects who reported liking the items and then ranked according to the 
proportion of the second 50 subjects who liked the items. The rank order 
correlation was .89. The same thing was then done on the basis of the 
likes of the first and second one hundi'ed subjects and again the rank order 
correlation was .89. 

In almost any group of American men selected at random, between 90 
and lOQ per cent will report they like to go to the movies, about one-half 
will report they like to dance. As reported later, age and perhaps educa¬ 
tional status help determine the individuals’ interests, along with multi¬ 
tudinous other factors, but in considering groups drawn from the general 
population, these interests form themselv^ into a remarkably stable order. 
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General intelligence has frequently been mentioned as one of the factors 
determining interestg. In order to see what relationship existed between 
the total number of likes reported by an individual and liis intelligence, 
comparisons on the basis of the number of likes wels made between groups 
receiving high, medium and low scores on the General Classification Test. 
Test scores were available for 172 of the 200 men selected at random. 
They were divided into three groups} 37 who had G.C*T. scores of 110 
and above; 47 who had scores of 89 and below, and 88 who had scores of 
between 90 and 109 inclusive. Tho cumulative percentage distributions 
of the number of likes for the three groups ore presented in the first three 
columns of Table 1. 

The average person in the low ability group likes 18 plus items. The 
average person of the medium ability group likes 18 plus items. The 

Table 1 


Distributions of Number of Likes Obtained wth Orally Pre-sented List for Three 
Different Ability Groups, Group of Discharged Recruits and Normal Rccruita 


No. of 
Items 
Liked 

G.C.T,«110 
and Above 

G.C.T. = 89 
and Below 

G.C.T. 

=90-109 

Inaptitude 

Dischargea 

Normal 

llecruita 

Proq 

Cum. 

% 

Freq. 

Cum. 

% 

Frcq. 

Cum. 

% 

Freq. 

Cum. 

% 

Froq. 

Cum. 

% 

22 

1 

lOO 

1 

100 

6 

100 



7 

100 

21 



3 

98 

11 

95 



16 

90 

20 

0 

97 

5 

92 

10 

82 



30 

80 

19 

2 

81 

9 

81 

9 

64 

1 

100 

21 

74 

18 

0 

70 

6 

62 

11 

54 



35 

63 

17 

4 

51 

5 

40 

ID 

41 

5 

93 

22 

40 

10 

7 

41 

5 

30 

11 

30 

2 

01 

30 

35 

15 

4 

22 

0 

20 

3 

17 

1 

88 

14 

20 

14 

3 

11 

2 

13 

5 

14 

3 

86 

10 

13 

13 





2 

8 

7 

82 

3 

8 

12 

1 

3 

1 

9 

2 

6 

9 

72 

5 

7 

11 







8 

60 



10 



1 

6 

1 

3 

9 

47 

3 

4 

0 



2 

4 

1 

2 

4 

34 

3 

2 

8 





1 

I 

5 

28 

2 

1 

7 







4 

20 



6 







3 

15 



5 







2 

10 



4 







2 

7 



3 







2 

4 



2 







1 

1 



Total 

37 


47 


88 


68 


200 
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average person of the high ability group likes 17 items. Inspection of the 
columns reveals little or no significant difference between the number of 
items liked by the three groups. This is particularly evident when the 
figures for the ability groups are compared with the figuvea for the dis¬ 
charged and normal-groups, which will be discussed later. The con¬ 
clusion seems warranted that, with this particular list of items, the range 
of interests bears little relation to general intelligence. 

The primary question about the list of items is how well does it differ¬ 
entiate between people who are making a good adjustment to military 
training and people who are not. The answer is found In the last two 
columns of Table 1. 

The column to the left presents the accumulative percentile ratings of 
the 68 inaptitude cases and the column at the right the same thing for the 
200 normal cases. These Sgurea are baaed on simply the number of likes 
reported by the individuals. The range for the inaptitude cases is from 
2 to 19, with fifty per cent of the cases liking 10 or fewer items. For the 
normal cases, the range is from 8 to 22, with fifty per cent of the cases 
liking 18 or fewer items. Of the inaptitude cases, 20 per cent like fewer 
items than any of the normals while of the normals, 87 per cent like more 
items than do any of the inaptitude cases. By choosing a critical point 
at 13 items, we would eliminate only 8 per cent of the normals and 82 per 
cent of the inaptitude cases. Such a small degree of overlapping is almost 
unprecedented when payohologioal instruments are used. Little question 
can be raised that the normal and atypical groups studied here most 
certainly differ on the basis of the number of likes they report. 

Printed Interest List. The preceding discussion concerns data col¬ 
lected in a brief, standardized interview. The collection of information in 
personal interviews has certain disadvantages, however, when dealing with 
largo groups. As has already been mentioned, this method in a few cases 
requires the interviewer to make judgment as to whether the subject's 
response indicates liking or not. To facilitate the collection of informa¬ 
tion and to eliminate any variability associated with the interviewer, the 
interest list was presented as a check list. A copy of the list and instruc¬ 
tions as presented to the subjects is presented in Figure 1. 

The mimeographed interest list was presented to 792 marine recruits, 
all the members of eleven consecutive platoons, immediately upon the 
completion of their physical examination and just prior to their interviews 
with the psychiatrists. Of these 792 men, 23 were selected by the psy¬ 
chiatrists to return for further examination because of suspected illiteracy 
and/or mental deficiency. Another group of 25 recruits was selected to 
return because of suggestions of other psychiatric or psychological defects 
—psychoneuroais, epilepsy, etc. 
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The check list was also pi^esented to 114 recruits wlio had been thor¬ 
oughly studied by the psychiatrists and psychologists and who were being 
recommended to the aptitude board by the psychiatric unit for inaptitude 
discharge. These were almo.st all of the recruits not of defective or bor¬ 
derline intelligencQ who were recommended to the board over a certain 
period of time. They were given the list after the final dcci.sion had been 
made to recommend their discharge. All of these reemits had at least 
two interviews with a psychiatrist and one with a psyoliologiat. Most of 
them had been seen twice by a psychologist. Many had several contacts 
with both psychiatrists and psychologists and many had been carefully 
observed in a special observation unit or carefully studied in the neuro- 
psychiatric ward of a Naval hospital. Social histories available for most 
of the recruits substantiated the information which led to the recom¬ 
mendation for their discharge. This group of discharged individuals in¬ 
cluded recruits diagnosed as having anxiety neurosis; constitutional psy¬ 
chopathic state, emotional instability; constitutional psychopathic state, 
inadequate personality; psychonourosis, mixed; post-traumatic syndrome; 
epilepsey; enuresis; psychoneuroais, hysteria; constitutional psychopathic 
state, schizoid personality; hypochondriasis; psychoneuvosis, psyohas- 
thenia; somnambulism; constitutional psychopathic inferior without 
psychosis; psychoneurosis, neurasthenia; cryptic nostalgia. 

Results for the Printed Interest List. Tiie range of scores obtained with 
the mimeographed list was greater and the distribution less skewed thaw 
with the scores collected in the interview. Therefore the calculation of a 
reliability coefficient was more feasible for the written list than for the 
other, Fi'om the total group of 792 cases, 100 cases were selected and 
the odd-even reliability was computed on the basis of the nural)er of likes 
checked on the even numbered items and the number of likes checked on 
the odd numbered items. The corrected coefficient was .88. Very few 
psychological tests with only 22 items have reliabilities high enough to 
warrant their use with individualB. 

Vocational interests are known to be influenced by age ^ and common 
sense suggests recreational interests are equally ns, if not more, susceptible 
to the influence of increasing age. The ages of 780 of the 792 subjects 
were known. The mean age of this group was 24,4 years, with a standard 
deviation of 7.9 and a range from 17 years to 49 years. The total dis¬ 
tribution was extremely skewed witli 318 of the cases falling within the 
17-18 year old group. The product-moment eorrclntioii of —, 13 between 
age arvd range of interests does not offer a true estimate of this relationship 
because of the skewness. 

^ Strong, E, K,, Jr. Change of inUreala wUh age. Stanfoi'd, Ca,ljf.: Stanford Univ. 
Press, 1931. 
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A better estimate of the ioftiience of age upon range of interests "waa 
obtained by comparing the number of items checked as liked by the 406 
men in the 17 to 22 year old group to the number liked by the 177 men in 
29-49 year old group. The distributions for these tTvo groups are pre¬ 
sented in Table 2. 


Table 2 

DifllriLtitionfl of Number of Likes Obtained with Printed List for 
DilTcrcnt Age and Bducntional Groups 


No, of 
Items 
Liked 

17-22 Yr. OJdfl 

29-4S Yr. Olda 

17-22 Yr. 03da 
Bth Grade 
or Less 

17-22 Yr. Olds 
H,S. Grad, 
or More 

Froq. 

Cum, 

% 

Froq. 

Cum. 

% 

Freq, 

Cura, 

% 

Preq. 

Cum. 

% 

22 

32 

100 

10 

100 

1 

100 

10 

100 

21 

21 

94 

6 

94 

4 

99 

5 

90 

20 

30 

88 

7 

02 

7 

04 

7 

84 

19 

22 

81 

7 

88 

4 

88 

9 

77 

18 

41 

75 

9 

84 

7 

81 

11 

08 

17 

28 

66 

6 

79 

4 

73 

8 

67 

16 

31 

68 

4 

76 

a 

68 

9 

48 

15 

30 

60 

a 

71 

8 

60 

4 

S9 

14 

20 

43 

u 

70 

7 

50 

11 

36 

13 

22 

35 

8 

62 

8 

41 

4 

24 

12 

24 

30 

10 

67 

5 

32 

6 

20 

11 

20 

24 

16 

61 

4 

20 

3 

14 

10 

13 

19 

13 

43 

3 

21 

2 

11 

0 

17 

16 

9 

36 

3 

18 

2 

9 

8 

17 

12 

10 

31 

1 

14 

4 

7 

7 

15 

7 

0 

26 

4 

12 

1 

3 

0 

5 

4 

7 

20 

4 

8 

1 

2 

6 

6 

2 

7 

16 

3 

4 



i 

3 

1 

12 

12 



1 

1 

3 

1 

1 

5 

5 





1 



4 

2 





Total 

406 


177 


85 


07 



In the younger group, 50 per cent of the men liked 15 or more of the 
activities. In the older group, only 30 per cent liked 15 or more items. 
Ill the younger gi'oup, 12 per cent liked only 5 or fewer items, while in the 
older group, 31 per cent liked no more than this many activities. Inspec¬ 
tion of the table reveals a substantial decrease in the number of activities 
liked as one moves from the younger to the older group. Table 3 presents 
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the per cent of people in eacli of these two ago groups nnd in the groups 
dwided upon the basis of education who check each item. In almost 
every cose, the difference agrees with expectation. 

Age brings a decreasing interest in dales. The younger men like to 
play horseshoes more than the older but this dilTeroncc is influenced by a 
greater preference of the younger, less well educated group. Age ap¬ 
parently bears little influence on interest in dancing or on interest in 
playing cards. Younger men arc more interested in parties, basketball, 
football and hiking. Older men are slightly more interested in watching 
bELseball and in reading. Inapeotion of the table indicates that changes in 
interest accompanying age arc not independent of the educational status 
of the individual. 

The above results show that when an individual’s range of intereata is 
to be used as a personality index, his age must be considered. A man of 
forty years cannot be compared legitimately with a youth of eighteen, 


Table 3 

PetCQntagQ of Vaxioua Groupa ChookiDg fliat They Liked Each Item 


Itooa 

17-22 Yrs. 17-22 Yra. 29-49 Yrs. 2(M0YrB. 17-40 Yra. 
8th Qr. More than 6th Gr. Morobhan StliGr, 
or 6th Qr. or Leas 8lh Qr. or Lcaa 

17-40 Yra. 
More than 
8th Gr. 

Fky ohookers 

71 

62 

60 

02 

01 

63 

Pky pool 

67 

70 

65 

66 

68 

00 

Flay horseahocB 

73 

67 

67 

59 

67 

01 

Dance 

40 

58 

41 

59 

41 

59 

Go on dates 

83 

83 

27 

39 

63 

68 

Box 

46 

48 

22 

32 

30 

42 

PUy cards 

68 

eo 

69 

60 

50 

01 

Go to paiUoB 

62 

72 

37 

44 

40 

62 

Play basketball 

55 

70 

18 

44 

34 

61 

Play baseball 

59 

77 

55 

64 

03 

73 

Play football 

65 

77 

22 

44 

30 

66 

Pishing 

76 

76 

71 

78 

70 

77 

Hiking 

57 

69 

40 

48 

48 

65 

Go bo camivala 

58 

68 

44 

41 

S3 

56 

Go on pionlcB 

54 

62 

52 

49 

63 

58 

Heading 

63 

71 

63 

62 

63 

76 

Go to movies 

90 

95 

77 

88 

30 

04 

Listen to radio 

83 

84 

76 

80 

81 

86 

Holler skate 

48 

56 

38 

33 

41 

48 

Watch baseball 

70 

71 

76 

79 

76 

73 

Watch football 

70 

81 

64 

72 

03 

80 

Go swimming 

79 

84 

69 

77 

75 

83 

No. of oases 

86 

289 

80 

116 

229 

483 
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Table 3 —Continued 


Item 

17-22 Yra. 

29-49 Yrs. 

Inaptitude 

Discharge 

Coses 

Normal 

Matched 

Controls 

Play checkers 

04 

67 

46 

49 

Ploy pool 

60 

66 

24 

62 

Play horeeshoos 

01 

5B 

32 

67 

Dance 

64 

61 

27 

47 

Go on dates 

83 

34 

27 

60 

Box 

47 

28 

11 

31 

Play cards 

60 

60 

37 

61 

Go to parties 

69 

41 

24 

48 

Play basketball 

67 

32 

14 

37 

Play baseball 

73 

60 

30 

05 

Play football 

71 

34 

26 

36 

Fishing 

76 

76 

62 

78 

Hiking 

50 

46 

17 

37 

Go to cornivola 

05 


27 

44 

Go On picnics 

00 

60 

38 

65 

Beading 

66 

74 

44 

71 

Go to movies 

04 

83 

56 

89 

Listen to radio 

84 

81 

70 

81 

Roller skate 

53 

36 

16 

46 

Watch baseball 

70 

77 

46 

72 

Watch football 

78 

64 

39 

66 

Go swimming 

82 

74 

34 

83 

No. of cases 

374* 

m* 

144 

144 


* The^B total numbers ol coses do not correspond with the totals presented in Table 2 
os some coses for whom complete data were not available were discarded and additional 
cases were obtained to increase the size of the older group. 


Separate normative tables must be used in order to provide a relevant 
frame of reference. 

Range of interests might also vary with the educational status of the 
individual. In order to test this hypothrais a group of high educational 
attainment was compared with a group of lower educational attainment, 
holding age relatively constant. In the group of recruits from 17 through 
22 years of age, complete data were avaiablc for 85 men who had finished 
no more than the 8th grade and for 97 men who had at least graduated 
from high school, 

In the higher education group, 62 per cent of the men liked 16 or more 
of the activities. In the lower education group, only 32 per cent liked 
16 or more items. In the higher education group, 86 per cent liked 11 
or more items, while in the lower education group, only 74 per cent liked 
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as many items. Table 2 presents the distributions f()r tlio two educational 
groups. Comparison of those differences with those found between the 
two different age groups reveals that much more variation in range of 
interests ia related to changes in age than to difforL'nce.s in education, 
although the influence of education ia ncvcrfcUclcsa marked. 

The total group for whom complete data were available was divided 
into those recruits who had completed the 8th grade or less and tho.se who 
had completed more grades than this. Tabic 3 pro.SGiits the per cent of 
17-22 year old men and 29-49 year old men in each of these two educa¬ 
tional groups who liked each of the bated items. The figures are also 
presented for all of the men who had comi)lctcd no more than the 8th 
grade and all who had completed more than this. 

Compariaon of the two columns of figures for the two educational 
groups shows fewer changes in interests related to education than to age. 
The more educated men show more interest in dancing, in going on dates, 
in going to parties and in athletics associated with Bceondavy scliools, 
The less well educated groups like to play horseshoes more than the others. 
The differences in intercata accompanying change in educational status 
well conform to the opportunities offered by our educational institutions. 

In order to determine the relative influence of ago and education upon 
responsca to the items, the 22 items wore ranked in ovclci’ of popularity 
among the 17-22 year old men and among the 29-49 year old men. The 
correlation between these two rank orders was +.52, indicating substan¬ 
tial shifting of item popularity os one moved fi'om the younger to the older 
group. The iteims were then ranked in order of popularity among the men 
completing 8 grades or less and among tho men completing more than 8 
grades. The correlation between these two rank orders was .78. These 
two correlations make plain that, although educational atatiia affects item 
response, age differences are far more effective. 

The author's impression is that age differentials must be allowed for in 
evaluating range of interests. Educational differences, however, need not 
be considered if convenisnee so dictates, although more exact information 
will be obtained if these differences are also taken into account. 

The primary question here, as it was with the oral list, is how ^vell does 
this list differentiate between people who aj*e making a good adjustment to 
military training and people who are not. 

Data were available for the three groups of non-adjusting individuals 
mentioned previously. The first group consisted of the 25 recruits se¬ 
lected by psychiatrists ns requiring further study not involving intellectual 
level or literacy. The mean age of this group was 23,1 years with a 
standard deviation of 6.24 years. The second group consisted of the 
23 recruits selected by psychiatrists oa requiring examination concerning 
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poasible mental deficiency or illiteracy. The mean age of this group was 
26.6 years with a standard deviation of 5.76 years. The third group 
consisted of those 114 cases who were pven inaptitude discharges. The 
mean age of this group was 25.7 years and the mean school grade com¬ 
pleted was 8.8. 

Distributions of the number of items liked by these different groups 
are presented in Table 4. Two diffetMit groups of normal recruits are 
presented for comparative purposes. 

Table 4 


DisfcributionB of Number of Likes Obteised with Printed List for Various 
Groups of Normal and Non-Adiuating Recruits 


No. of 
Items 
Liked 

Screeued for 
other than 
M.A. or 
Reading 

Screened for 
M.A. or 
Reading 

Aptitude 

Discharges 

Normal 
Recruits not 
Screened 

Nornial8_ 
^latched with 
Aptitude 
Disohargea 

Freq. 

Cum. 

% 

Freq. 

Cum. 

% 

Freq. 

Gum. 

% 

Freq. 

Cum. 

% 

Freq. 

Cum. 

% 

22 



2 

100 

1 

100 

46 

100 

6 

100 

21 





2 

98 

34 

94 

3 

04 

20 

1 

100 



2 

97 

46 

80 

4 

02 

10 

1 

90 

1 

92 

1 

05 

39 

83 

6 

88 

18 

2 

02 

1 

88 

2 

04 

64 

78 

11 

83 

17 

2 

84 

1 

82 

1 

03 

38 

69 

1 

74 

10 

1 

76 



2 

02 

45 

64 

0 

73 

Id 



2 

78 

2 

00 

42 

58 

4 

65 

14 



a 

70 

4 

88 

54 

62 

7 

6l 

13 

2 

72 

1 

56 

3 

85 

38 

46 

4 

66 

12 

1 

64 

1 

62 

2 

82 

51 

30 

8 

62 

11 

4 

60 

1 

48 

2 

81 

47 

32 

11 

46 

10 

1 

44 

i 

44 

4 

80 

39 

23 

6 

35 

0 

2 

40 

4 

39 

7 

75 

29 

21 

11 

20 

8 

,2 

32 

2 

22 

11 

70 

28 

17 

3 

21 

7 

2 

24 



11 

60 

32 

13 

7 

18 

6 



1 

13 

10 

60 

16 

8 

6 

12 

6 

1 

16 

1 

8 

11 

41 

17 

6 

3 

8 

4 

2 

12 



14 

31 

17 

4 

3 

6 

3 

1 

4 

1 

4 

12 

ID 

7 

2 

3 

3 

2 

1 





10 

8 

4 

1 



Total 

25 


23 


114 


732 


114 
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The firat group of 732 nornml recruita includes all recruits for whom 
ages were available and who were not selected by paychiatriatH as needing 
further examination. The mean age of this group was 25.4 years with a 
standard deviation of 4.0 years. Tlic second group of normal controls 
consisted of 114 recruits aelected from the larger control group and 
matched with the 114 discharged cases on the basis of age, highG.st grade 
completed, and nge at leaving school. The effectiveness of this matching 
is revealed by comparing the mean age of 25,f) of this normal group and 
their moan grade attainment of 8.8 with tlie similar figures just presented 
for the 114 discharged recruits. 

Comparisons of the distributions indicate that, with education and age 
constant, the non-adjusting individuals and the normals arc differentiftted 
by their ranges of interests as measured by this list. When a group of 
individuals is tested and then from this group, people aye selected by 
paychiatriata aa requiring further examination, this selected gi-oup will 
have restricted ranges of iafcctesits. Similarly, when a group, already 
studied by paychiatriata and psychologists and found to liavc an unfavor¬ 
able prognosis, is tested, people in this group will also liavc restricted 
ranges of interests. 

The mean scores of the two matched group.s were compared, The 
mean score of the 114 normal cases was 12.8 with r standard deviation of 
6.2, The mean score of the 114 discharged co.'jcs was 0,0 with a standard 
deviation of 5.0. The critical ratio of the difference between these two 
means, baaed on the standard error of the difference and taking into ac¬ 
count the low but positive correlation between the groups, was 9.7. 
Beyond all doubt the scale differentiates between the two groups. 

In the discharged group, 50 per cent liked six or fewer items,while in 
the normal group, only 12 per cent liked 6 or fewer items. In the normal 
group, 35 per cent liked more than 15 items while in the discharged group 
only 10 per cent like aa many items. The relatively small amount of 
overlapping indicates the list measures a trait which clearly differentiates 
those people who have adjusted to military training and those who have 
not and this trait can be measured with sufficient exactitude to be useful 
in individual cases. 


Conclusion 

The preliminary work with the orally presented list and the later work 
with the printed list show thot the range of interests offera an indirect 
and convenient method for ptedicting adjustment to military training. 
The results show more overlapping between groups with the printed list 
than with the oral list. The more careful control of age and educational 
factors obtained in the analysis of the printed list, however, must be 
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considered. This and the greater convenience and objectivity of the 
printed list give it added advantage. 

The method can be ueeful in several situations, Firat it may be used 
as a screening device. As it does not select mental defectives and perhaps 
many other groups aimed at in psychiatric screening, the list is in itself 
not a sufficient screening technique. Hunt, Wittson and Harris * have 
concluded that screen tests are most useful to the military psychiatrist in 
supplementing the results of his clinical interview. Moat acceptable is 
their suggestion that screening teats, such as developed here, and the 
psychiatric interview are best used to complement each other. 

The method is also useful in the collection of information to be used in 
making the final judgment as to whether a recruit should be retained in 
military service or not. The validity of these judgments is dependent 
upon the reliability, the relevancy and the amount of information upon 
which they are baaed. 

The analysis leaves little question that groups not adjusting well to 
military training tend to have significantly restricted ranges of interests 
and this restriction can be measured reliably in individual cases and used 
in making prognostic judgments. 

Received My 17,19U- 

* Himtj W. A., Wittflon, C. L., and Harris, H, I. The screen teat in military selestlon. 
Psychol Reo,, 1W4, 51, 37-40. 



A Note on the Problem of Brain Damage in Rehabilitation 
and Personnel Work 

Howard F. Hunt 
oj Minneaela 

Brain injury in the adult human being is usually followed by altera¬ 
tions in personality and intellectual ability os well os by alterations in 
physical status, The symptomatology and vocational implication of 
these alterations deserves discussion since many returning brain-injured 
veterans will be only partially incapacitated and will desire some means 
of self-support. TJie question of the employability of brain-injured 
persons is an important one at the present time, moreover, since this 
condition is not too uncommon among the general population as n result 
of accidents, disease, and excessive use of alcohol, This discussion is 
intended to provide personnel and rehabilitation workers who have not 
specialized in clinical psychology with useful information for dealing with 
brain damage caaea. Only the psychologic aymptoms of greatest practical 
import from thestaudpeint of vocational guidance and personnel work will 
be discusacd here. No attempt will be made to discuss the “basic, under¬ 
lying defect, or defects" of which these more or less superficial symptoms 
are a function. 

The residuals of brain injury may, for purposes of convenience, be 
classified under two headings: primarily physical or somatic symptoms 
and symptoms which are primarily behavioral or psychologic- Among 
the more important physical symptoms are included: weakness and fa¬ 
tigability, convulsive disorders, sensory and motor disorders (including 
the aphasias), and defects in muscular coordination. These symptoms 
are generally detectable by routine physical and neurological examinations 
and from the medical history obtained from such a person, With the 
possible exception of the aphasias, the somatic disabilities usually come 
within the purview of the physician and will not be diaouased here. 

The paychalogical symptoms conaiat Buperficially of intellectual de¬ 
terioration and alterations in the individual's emotional life and per¬ 
sonality. The severity of the symptoms depends largely upon the 
severity and extent of the damage incurred and upon the prior personality 
organization and intellectual level of the affected individual, vaiying 
quantitatively from exceedingly subtle alterations in persons who super¬ 
ficially seem quite normal to gross dementia with disorientation as to 

282 



Brain Damage in HehabHUalioTi and Personnel Work 


283 


time, place and even person. In some cases both the psychologic and 
somatic symptoms may be pi-escnt in varied degrees and combinations, 
while in other caeca either the psychologic or the somatic symptonis alone 
may be appreciable. Even relatively small areas of damage in certain 
locations may produce distinct physical symptoms but little or almost no 
psychologic alteration, whereas lesions placed in other areas of the brain 
may result in beliavioral defects unaccompanied by appreciable somatic 
fiLinormality. Wc are primarily concerned with the latter type of case 
in this discussion. 

The intellectual deterioration or loss of intellectual ability resulting 
from brain damage apparently involves those more dynamic aspects of 
intelligence which are crucial for problem solving. Brain-damaged per¬ 
sona commonly show some loss of memory for recent events, a symptom 
which is related to their decreased ability to learn unfamiliar material 
or new tasks. They also show rigidity and perseveration in their mode 
of attack on new p roblema and in their behavior in general. This defect is 
manifested in their decreased ability to organize or synthesize new be¬ 
havior patterns and in their tendency to continue to apply old, familiar 
methods of solution to new problems even after the method has proved 
unsuccessful. This characteristic may appear in social situations in the 
guise of decreased ability to follow rapid shifts in the form and content of 
conversations and diminished skill in coping with sudden turns of events. 
In addition to tlieso symptoms, a general slowing of thinking and speed 
of reaction as well as an increased distractibility are often observed, 
In general the old, familiar response patterns, habits, and skills are rela¬ 
tively unaffected by mild to moderote degrees of brain damage. 

Alterations in the individual's emotionality and, consequently, in 
personality frequently follow brain damage. Emotional reactions tend 
to be move easily aroused and to greater heights in the brain-damaged 
person than in the normal pereon, and they tend to abate more rapidly 
once aroused. Thus, these people often give the impression of a relative 
lack of inhibition or emotional control as well as of deficient foresight 
and concern about their own future or the consequences of their acts. 
Many show a mild degree of perhaps unjustified optimism and buoyancy 
or euphoria, while some others may show a tendency toward an exaggera¬ 
tion of their previous personality characteristics. These symptoms, plus 
the accompanying intellectual changes, set the stage for childish or anti¬ 
social and unethical behavior in predisposed persons. In general, the 
individual's power of adjustment to society and to the problems of every¬ 
day life is diminished. 

No specific personality “type" seems to be invariably peculiar to or 
characteristic of brain-damaged persons. In the case of adults, the de- 
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fects described above are imposed on a matured personality "system” or 
structure. The resultant behavior charncteriatica will thus be a product 
of the interaction between the individunrs original peraonality and intel¬ 
lectual level and the specific residuals associated with brain damage, plus 
the frequently exaggerated reactions of this modified personality to the 
stresses and strains incidental to the demands of daily life, This latter 
factor may be particularly important in some caaes since the brain- 
injured person’s goals ond expectations may remain relatively unaltered 
though hia capacity for achieving them is reduced. Thus, a person whoso 
powers of adaptation and emotional control arc diminished must often 
live under and adjust to particularly trying circumstances. It is not 
surprising that some brain-injured persons develop psychoneuroses or 
exhibit aooially unacceptable behavior. Seneori-motor and speech de¬ 
fects or convulsive disorders may also complicate this situation, a.5 may 
psychoneurotio reactions on the part of the affected person to the idea of 
being handicapped or to the circumstances associated with a spectacular, 
injury-producing accident or ilinesa. 

Because there is no regeneration of destroyed neuronal tissue within the 
brain, the permanence of the defects i^ociated with brain damage has 
sometimes been assumed. Partial and sometimes almost complete clini¬ 
cal recovery does occur in some cases, however; but in which cases it will 
occur cannot yet be predicted accurately. Hecovery, if it is to occur to 
an appreciable degree, is usually well under way within a period of a few 
months after injury and is not generfdly to be expected in cases of long 
standing deterioration. 

This discussion has been primarily concerned with the symptoms of 
cases in which brain damage occurs after the individual has attained 
almost full intellectual growth, that is the person ia fifteen or sixteen 
years old. The defects resulting from damage earlier in life are somewhat 
similar with additional complications arising from arrested or uneven in¬ 
tellectual and personality development; consequently defective education, 
often with marked and specific deficiencies in one or more of the tool 
subjects such as arithmetic or reading; and the development of various 
compensatory habits and unacceptable ruction patterns. Probably only 
the less severely affected cases of this type will be encountered in the 
employment situation since, in moat cases, the segregating and selecting 
iafiuences of school and society have eliminated the grossly unfit from, 
the active labor market. 

The vocational prognosis attodied to brain-damaged persons depends 
upon a number of factors. The severity of the handicap in such persona 
is relative to their original intellectual level and personality. It depends 
not only upon the extent and placement of the damage and upon the 
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absolute magnitude of the intellectual and emotional alterations but also 
upon the individual’s original intellectual ability, education and training, 
and the excellence of hia personality integration and adjustment. The 
magnitude of the handicap is also relative*to the type of work he wishes to 
perform and to hia interest in and familiarity with it. 

The exact vocational implication of mild to moderate psychologic 
defect following brain damage is as yet unknown, but a few generalizations 
may be drawn from our relatively limited clinical experience with it and 
on the basis of the symptoms of the condition. Occupations placing a 
premium on physical stamina, invenfiveness and ingenuity, emotional 
control, and diplomacy in inter-pemonal relations are probably contra¬ 
indicated in the majority of cases just as are positions involving great 
personal responsibility both for the welfare of other persons and for vital 
programs or equipment. Special experience and training or ability and 
good personal adjustment coupled with relatively minimal intellectual 
and emotional changes, however, would warrant exception to the above 
generalizations in some cases. Usually, nevertheless, even mild psy¬ 
chologic defect is probably an unfavorable prognostic sign with regard to 
both vocational and personal adjustment. 

Though diagnosis and treatment of brain damage are primarily 
medical problems, the standard techniques utilized by physicians fail to 
yield certain types of information crucial to the vocational management of 
affected persons, Medical facilities for detecting and estimating the 
severity of the psychologic symptoms associated with brain damage con¬ 
sist largely of unrefined, uncalibtated teste aided by subjective, clinical 
impressions and estimates. These techniques yield relatively unreliable 
estimates of degree of deterioration. Ateo, since they are relatively 
insensitive, they may fail to detect minimal defects, especially in cases 
where the physical symptoms are not appreciable. In a few cases, more¬ 
over, the physical and neurologic examination findings may be entirely 
negative, the psychologic defects minimal, and the brain damage detect¬ 
able only by refined psychometric methods. Recent advances in clinical 
psychology have provided more adequate and more sensitive methods. 
Though these methods do not “measure" in the strictest mathematical 
sense, they represent a marked improvement over the traditional medical 
techniques in that they are somewhat more sensitive and do yield rough 
estimates of degree of deterioration. They are particularly useful in 
evaluating the employable brain-damage cases—those with relatively 
minimal defect. 

Clinical psychology has, however, no special technique to offer for the 
detection of minimal alterations in the emotionality of brain-damaged 
persons. The standard personality tests are of considerable value in 
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assessing the actual personality diaracteriafcics of these people, neverthe¬ 
less. A personality deviation in a brain-damaged person may have more 
serious implications than a similar deviation in a person who is intact. 

To be of practical value in the personnel or vocational guidance situa¬ 
tion, a psychometric instrument must not require ex tended administration 
time or extensive, cumbersome equipment, and yet it must be maximally 
sensitive. Ease of administration and scoring as well as interpretability 
are also crucial. Of course, the test mu.st have clinical validity and be 
applicable to the type of pemon being tested, applicable both from the 
standpoint of its content and from the standpoint of its standardization. 
As is well known, however, the use of teats provides no royal road to 
diagnosis, The pitfalls for the unwary are many, and the thoughtless 
clinician all too easily may be lulled into a false sense of security by the 
arithmetic form and so-called “objectivity” of teat results. A teat is no 
better than the climcian who uses it, and an otherwise useful teat may be 
rendered ineffective by thoughtless, careless administration and naive 
interpretation. The examiner must be thoroughly familiar with the ad¬ 
ministration technique as well as fully cognizant of the psychologic aspects 
of the task and total situation with which the te.sted person is confronted. 
This is particularly important in brain-damaged cases because of their 
characteristic emotionality and psychologic defects. Naturally, test re¬ 
sults must be considered as but a part of the evidence required for diag¬ 
nosis and must always be interpreted in the light of all the rest of the data 
relevant to the case being studied. 

The standard intelligence teats have often been used to detect intel¬ 
lectual deterioration, but they are somewhat ineffective tools for this 
purpose from the strict psychometric standpoint because of their relative 
insensitivity to this condition. They may, however, provide the occasion 
for behavior of great diagnostic significance to an experienced clinical 
psychologist, In general, the eame evaluation applies to the Rorachach 
(ink blot) method when used as a deterioration test. Moreover, much 
specialized experience and training are required for proper administration, 
scoring, and interpretation of this procedure. Accordingly, the use of 
psychometric instruments specially designed for the detection of deteriora¬ 
tion is advised, particularly in borderline cases. 

A number of deterioration testa have been developed, but the more 
effective of such teats have been based upon what might be called the 
differential sc ore technique which was originally suggested by Babcock (1). 
This technique involves measuring the discrepancy between a person's 
performance on tests sensitive to brain damage (tests of learning, memory, 
abstract thinking) and his performance on tests relatively insensitive to 
this condition (tests of vocabulary, information). Significant discrepan- 
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cies indicating impaired perfonnance on the sensitive teats relative to 
pei’formance on tiie insensitive teats would thus suggest brain damage. 
This neat situation ia complicated, however, by the tendency of depressed, 
anxious, schizophrenic, and other varieties of disturbed persons to obtain 
similarly discrepant scores on the two types of tests. Thus, such patho¬ 
logic discrepancies, or deterioration scores, are ambiguous diagnostically 
and should be confirmed by case history and neurologic examination data 
before anything stronger than a suspicion of brain damage is justified. 

In cases with pathologic deterioration test scores, differentiation as to 
the etiology of the score ia important from the standpoint of long-time 
vocational prognosis, Pathologic scores attributable to emotional- 
motivational disturbances as in the depressions and the anxiety states 
indicate an impairment of intellectual efficiency which usually disappears 
when the afflicted individuals recover. Schizophrenic deterioration gen¬ 
erally disappears in a like manner in those cases which do recover. In 
contrast, the intellectual impairment associated with brain damage is 
usually considerably less transient and is accompanied, therefore, by a less 
favorable vocational prognosis. Because of the proneness of brain¬ 
damaged persons to emotional disturbances, the more permanent impair¬ 
ment associated with the brain damage may be temporarily augmented by 
depression, anxiety, and the like. Under these conditions, the ultimate 
intellectual status of the person is difficult to determine since some of the 
impairment indicated by the test score may be expected, in many cases, 
to disappear u'hen emotional equilibrium ie regained. 

Deterioration test scores are thus not a final index of vocational prog¬ 
nosis but rather a diagnostic and prognostic aid. The extent to which 
they aid diagnosis and prognosis depends to a substantial degree upon 
the skill and clinical acuity of the interpreting clinician. 

Of the available, specially devised deterioration tests for adults, the 
Shipley-Hartford Deterioration Test (8) is the easiest to administer. It 
ia a twenty minute, self-administering, paper and pencil test which may 
be used only with cooperative, teat-sophisticated subjects of average or 
above average intelligence. 

The Babcock-Levy Revised Test for Efficiency of Mental Functioning 
(2) is an individual test very similar to the standard individual intelligence 
tests in the time, skill, and amount of equipment required for administra¬ 
tion. It is applicable to cooperative persona of a somewhat less restricted 
range of intelligence and test-sophistication than is the Shipley, The 
norma for these two tests include no correction for normal deterioration 
with advanced age, so subjective correction for this factor must be made 
in the interpretation of the test performances of older persons. 

The Hunt-Minnesota Test for Organic Brain Damage (4) is an indi- 
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vidual teat requiring aome practice but relatively little equipment for 
administration. The test can be completed in from fifteen to thirty five 
minuteSj depending upon whether the short or the long form ia used. 
It is applicable to cooperative adults with mental ages of over eight years, 
and the norms include a statistical correction fPr normal age changes 
within the range of sixteen to seventy years. Scores on this test obtained 
from persons near tlie extremes of the age and intelligence ranges must be 
interpreted with considerable caution, however. 

“Psychological deficit” has been suggested (6) as an inclusive but 
neutral term for the impairment of intellectual efficiency associated both 
with brain damage and with emotional-motivational disorders. The 
three tests described above are apparently fairly effective in detecting 
this deficit. In the development of the Hunt test, an attempt was made 
to provide a special means for identifying those pathologic scores attribut¬ 
able to emotional-motivational diaturbancea so that the test would then be 
a specific test for the deterioration associated with brain damage. This 
attempt has been only partially successful. Since neither the Shipley 
nor the Babcock tests make this discrimination, pathologic scores on any 
of these three tests may indicate either brain damage or an emotional- 
motivational disturbance accompanied by poor cooperation, motivation, 
and attention. Consequently, great care must be exercised in the inter¬ 
pretation of scores obtained on these teats. 

Received July 18, 1944’ 
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Personality Patterns of Adolescent Girls: 

II. Delinquents and Non-Delinquents 

Dora F. Capwell 

Trainee Aceeplarue Center, Public SchooU, Pittsburgh, Pa. 

In a study devoted to the peiaonality patterns of adolescent girls who 
show improvement in IQ (2) two groups of girls were used os subjects, a 
group of delinquents and a group of non-delinquents. A series of per¬ 
sonality teats were administered to each group on two occasions along 
with teats of intelligence and academic achievement. The results of the 
personality teats, aside from their contribution to the original problem, 
are of special interest due to the degree and manner in which they differ¬ 
entiated the delinquents from the non-delinquents. Most present day 
students of delinquency agree with the point of view expressed by Lowrey 
(10). “Delinquency is probably moat frequently due to the subtle effects 
of interactions between individual and environment, leading to the es¬ 
tablishment of particular personality sets.” However, there has been 
disagreement regarding the success with which one can measure and 
delineate these personality sets by means of standard, objective tests of 
personality. The following results show the differences of personality 
between a group of delinquent girls and a group of non-delinquent girls 
as measured by one series of personality tests. 

The procedure has been described in detail in a previous report (2). 
A total of 101 delinquent girls at the Minnesota State School for Girls and 
85 non-delinquents in the Public Schools of Sauk Centre, Minn., were 
given a psychological examination and re-examined from 4 to 16 months 
later, The personality teats which were given twice were the Minnesota 
Multiphaaic Personality Inventory (6), the Washburne Social Adjustment 
Inventory (13) and the Pressey Interest-Attitude Test (11), Two other 
tests of personality, the Terman-Miles Teat of Masculinity-Feminity (12) 
and the Vineland Social Maturity Scale (3), were given just once. The 
levels of intelligence and academic achievement were determined by the 
Kuhlmann Teats of Mental Development (9) and the Stanford Achieve¬ 
ment Test (8). 

Results 

Before examining the personality test results, it is important to note 
the differences between the two groups in intelligence and achievement. 

289 



290 


Dora F. Capwell 


The non-delinquents were girls of higher intelligence, showing a mean IQ 
on the first test of 101, as compared with a mean of 87 for the delinquents, 
The standard deviation for each group was 17. Each group showed some 
retardation in school achievement when compared with the norms of the 
Stanford Achievement Test. The delinquents were more retarded than 
the non-delinquentSj as would be expected, but the differences are not 
statistically reliable. The amount of retai‘dation in terms of grade scores 
is shown in Table 1. 

Table 1 

Difference between Actual Grade Level aod Achievement Grade Score * 

li/vD 

Delioquenta Non-Delinquenta between 

N »97** * 85 Delinquenta 

- - and Non- 


Score 

Mean Dilf. 

S.D. 

Mean Diff. 

S.D. 

Delinquents 

Total Score 

-1.30 

1.41 

-.82 

1.50 

2.28 

Reading Score 

-.55 

1.52 

-.49 

1.46 

.28 

Arithmetic Score 

-1.06 

1.76 

-1.28 

2.03 

2.42 


* 1,00 equals one total grade. 

** Four delinquents were absent when these teats were given. 


The peraonality tests, discriminated the delinquents from the non- 
delinquents with varying success; two of them showed striking differences. 
The significance of differences between the two groups on the Minnesota 
Multiphaslc Peraonality Inventory is shown in Table 2. 

Table 2 

Minnesota Multiphoaic Personality Inventory—Significance of Difference of Raw Scores 

Difference between Delinquents and Non-Delinquenta 


Scale 

First Teat 

D/vD 

Second Teat 

D/ffD 


2193 

4.25 

L 

1.76 

3.30 

P 

7.21 

5.95 

Ha 

3.11 

3.12 

D 

4.50 

2.02 

Hy 

2.74 

.00 

Pd 

16.00 

14.00 

Pa 

12.00 

8,03 

Pt 

0.64 

7.36 

So 

7.10 

8.56 

Ma 

8.00 

7.95 





Personality Patterns of Adolescent Girls: II 


291 


Each scale except the Hy, or Hysteria scale, shows a clear differentia¬ 
tion between the two gj’oups. The greatest difference appeal’s in the 
scores for Pd (Psychopathic Deviate). The extent to which the Multi- 
phasic differentiated the groups may be seen in Table 3, and Figures I 
and 2 show graphically the differences in average T-scorea between the 
two groups. 


MULTIPHflSIC SCfllCS 



Fig. 1. T-acoro profile on the Multiphnsic Inventory for the Delinquent (D) 
and Non-Delinquent (N) groups, 1st test, 


hULJiniAStO SCALSS 



Fiq. 2, T-acoro profile on the Multipliaaio Inventory for the Delinquent (D) 
and Non-DoHnquent (N) groups, 3nd test. 

Table 4 shows the significance of diffei'ences between the raw scores 
of the other personality tests. The Washbume and the Vineland differ¬ 
entiated between the delinquents and non-delinquents, but the Pressey 
Interest-Attitude and the Terman-Milea did not. On the Washbume 
54% of the delinquents reached or exceeded the 75th percentile of the 
non-delinquents’ scores on the first examination, and 51% did bo on the 
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Tabic 3 

Porcontago of Ovorlap on tho Multiphoaic 



Percentage of DoUnquenta who Reached or Exceeded 


tho 75th Percentile of Mon-Dclinquonts 

MuUiptasic Scale 

lat Teat 

2nd Tost 

Hb 

41% 

48% 

D 

48% 

37% 

Hy 

32% 

16% 

Pd 

03% 

92% 

Pa 

84% 

05% 

Pt 

01% 

01% 

Sc 

64% 

71% 

Mtt 

64% 

71% 

second examination. 

The Vineland showed differences 

in the other direc- 

tion, in that on the other personality tests a high score tends toward 

maladjustment, while 

on the social maturity scale a high score is a favor- 

able one. On the social maturity scale only 31% of the delinquents 
reached or exceeded the median of the non-delinquents. 


Table 4 


Other Personality Testa—Sigoificimce of Difference of Raw Scores 



Difference between 



Delinquents and 
Non-Delinqucnte 

Teat 

Test No, 

D/trD 

Washburne 

lat 

S.31 

Woahburno 

2Ad 

4.54 

Preasoy 

lat 

.62 

Pressey 

2nd 


Terman-Milea 

(one only) 

.80 

Vineland * 

(one only) 

3.06 


* D/crD between social quotients. 


Inasmuch as the two groups which were dilTerontiated by the MuJti- 
phasic, the Washburnc, and the Vineland differ in level of intelligence as 
well as in regard to delinquency, it is necessary to find out if the personality 
test differencea are related to the differences in intelligence. Hence, 62 
delinquents from the group were matched within two IQ points with 52 
of the non-delinquents in order to compare personality differences and 
percentage of overlap on those tests which, differentiated the groups re¬ 
liably. The mean IQ of each group was 96 with a standard deviation of 
14. Only those tests were compared which differentiated the larger 
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groups. Results obtained with the matched groups may be seen in 
Table 5. 

The MuHiphasic continued to difici'e&tiate the delinquents and non- 
delinqucnts reliably with the exception of the Ha scale. Ply waa not used 
because it did not differentiate the larger groups. The Washburne fell 


Table 5 

Matched Groupa of Delinquents and Non-DeUnquentai Significance of DiSerence of 
Raw Scores on First Examination and Percentage of Overlap 


Tost 

D/ffD 

Percentage of Delinqnenfcs who 
Reached or Exceeded 75th 
Percentile of Non-Dclinquenta 

Mulliphaaic 



Ha 

1.Q5 

— 

D 

3.91 

56% 

Pd 

10.34 

03% 

Pa 

8.43 

84% 

Pb 

4.80 

67% 

Sc 

4.00 

67% 

Ma 

6.22 

63% 

Woahburno 

2.70 

50% 

Vineland 

.38 



slightly below satisfactory reliability of differences, and the Vineland 
failed to demonstrate any real difference when the groups were matched 
for IQ. Plence, the differences on. the Vineland appear to be related more 
to intelligence than to delinquency, but the differences on the Washburne 
and the Muitiphasic continue to be aignificaut. 

Discusaion 

The test which differentiated moat clearly between these two groupa 
was the Multiph/isic, The results, whidi include the three validating 
scoreSj show first of all that oven quite young adolescents do answer a well- 
devised personality inventory validly. The mean validity scores arc 
close to a T-score of 50 for all groups, except for the delinquent scores on 
the F-acale; these were higher, but not auABciently so as to invalidate the 
results. They would be expected to be somewhat higher than the F-scoi'es 
for the non-delinquents because of the much greater amount of maladjust¬ 
ment in the delinquent group, and since, as stated before, there is a slight 
tendency for the F-score to be higher as gross maladjustment increases. 
The non-delinquents had many more responses than the delinquents, 
due probably to two factors: first, they were a slightly younger group and 
found more items they did cot understand, and secondly, the delinquents 
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had more leisure at the time of taking the testa. On the whole, however, 
the results from both groups showed a reassuring degree of validity. 

It has long been believed that delinquents are more generally unstable 
than the normal population, and the Multiphaaic Inventory bore out this 
belief by showing a significant difference of mean scores between delin¬ 
quents and non-delinquents on seven of the eight scales, the delinquents 
scoring further away from the mean for the normal population, Even 
when the scores were not equivalent to a T-score of 70 or over, the criterion 
for significant maladjustment, they still were further toward the malad¬ 
justment end of the scale than were the scores of the non-delinquents. 
The moat conspicuous differences were on the scales of Psychopathic 
Deviate and Paranoia. The delinquents had a mean T-score of 73 on 
the Pd scale and 65 on the Pa scale. 

The delinquents were not aa depressed as one would imagine, on their 
arrival at a correctional institution. That they are not is a finding which 
is conaiatent with the theory of the psychopathic deviate set forth by- 
Hathaway (6), suggesting that the psychopathic inferior or deviate hoe 
trouble in his relations to society partly because he does not react witli 
the emotions with which the normal person reacts under similar oiroum- 
atances. Therefore, although the newly committed delinquent may seem 
to feel very badly, cry noisily, and appear to be extremely depressed, the 
test scores and also the speed with which she often recovers from this mood, 
attest to the belief that it is a relatively superficial emotion. In the 
non-delinquent group only two girle made scores on the Pd scale as high 
as the mean for the delinquent gi‘Oup. Of these two one was a girl so 
maladjusted that she was being considered for foster-iiome placement by 
the child welfare worker of the county, and the other was a girl who had 
left school for a time, returned of her own volition, but was again con¬ 
sidering leaving and was eo upset that she was of concern to the school 
principal; she herself asked for a conference with the examiner to talk 
^bout her difficulties. Thus, this test measures adjustment in the same 
sense in which non-delinquents are better adjusted than delinquents. 

Two other personality teste, the Pressey Interest-Attitude Test and 
the Terman-Miles Test of Masculinity-Femininity, when their raw scores 
were compared as with the other tests, did not discriminate between the 
delinquents and non-delinquents. This ia contrary to the results implied 
by the report of Durea and Fertmon (5), who gave the Pressey to 180 
delinquent girls. Their study merely showed, however, that the scores 
from the delinquents compare “unfavorably with norma for non-delin¬ 
quents,” No control group was used at the same time. In the present 
data the delinquents compare unfavorably with the noTms. but so does 
this particular sample of norma! cases. These same normal girls made 
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normally expected scores on the other tests. The Preaaey apparently does 
not measure the type of adiustment measured by the Multiphasie or the 
Woshburne. The Tcrman-Milea did not show significant differences 
between the groups, but each group contained some cases of extreme 
scores, as one may judge from the standard deviation of the groups. The 
deviate cages were not always the girls who tested as most maladjusted 
on other testa. 

The Vineland Social Maturity Scale did not show as much difference 
in social maturity as might be expected between the delinquents and 
non-delinquents. These girls do not show as much social retardation as 
the delinquent boys reported by Doll and Fitch (4), but there are other 
marked differences between the boys they studied and the girls of this 
study, the most important one being that the boys were much more 
retarded mentally than the girls are. The median mental age for the boya 
was 9.3 years, as against a median life age of 14 years. The social 
quotients were nearer the mental ages than the life ages. In the present 
group of delinquent girls the mean social quotient is 4 points below the 
mean IQ and is more related to intelligence level than delinquency. 

In concluding the discussion of these test results a word may be said 
about the use of personality teats as measures of p^djustment both with 
groups and individuals. Whether or not one considers them valid and 
helpful instruments to aid diagnosis appears to depend largely on the 
selection of tests one uses. Boynton'and Walsworth (1) used six tests, 
all different from the ones used in the present study, with 47 delinquent 
and 60 normal girls and found that only one score of one test yielded a 
C.R. of 3.00 between the groups. They concluded that the tests "in the 
main do not provide empirical evidence of sufficient validity to justify 
one in putting a great deal of faith in them in individual and group 
diagnosis," They concluded further that since there was such disparity 
between the test results, delinquent behavior is not necessarily associated 
with personality aberrations. Somewhat different conclusions are war¬ 
ranted from the results of tests used in the present study. Two of them, 
the Terman-Miles M.-F. Test and the Preasey Interest-Attitude Test, 
were not helpful in differentiating delinquents and noii-delinquents, Two 
others, however, gave satisfactory differences and should be helpful in 
either individual or group diagnosis; these two were the Minnesota Multi- 
phasic Personality Inventory and the Washburne Social Adjustment 
Inventory. The results of both suggest that personality aberrations 
frequently are associated with delinquency. The use of personality tests 
with any special group necessitates careful selection of tests on the basis 
of the way they were standardized as well as their suitability for providing 
the desired information. Beyond that, experience with the results in 
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the particular group concerned is necessary before a fair evaluation can be 
made of the usefulness of the test. Generalization from a selected group 
of personality tests to all testa of that type is not warranted any more 
than from one intelligence test to another. 

Summary and Conclusions 

A group of 101 delinquent and 85 non-delinquent girls were tested with 
a battory of personality teats and retested from 4 to 15 months later. 
Differentiation between the two groups was measured by computing the 
significance of difference of the mean scores for each group and also the 
percentage of overlap. The groups differed in level of intelligence os well 
as in delinquent tendencies, so the effect of mental level on the personality 
test scores was investigated by similar statistical treatment of the scores 
of 52 girla from each group who were matched far IQ. The results led 
to the following conclusions: 

1. The Minnesota Multiphasic Teraonality Inventory and the Wash- 
burne S.-A. Inventory discriminated the delinquents from the non¬ 
delinquents in degree of personality adjustment. 

2. The Vineland Social Maturity Scale showed differences which were 
more related to intelligence than to delinquency. 

3. The Pressey Interest-Attitude Teat and the Terman-Milcs Teat of 
Mascubnity-Pemininiby did not discriminate the delinquents and non- 
delinquents, 

4. Personality tests may be of value with individuals or groups in 
measuring and describing the pcraonality patterns of delinquent as 
distinguished from non-delinquent girla. 

Received June 13, IHi. 
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The Construction of the Guilford-Martin 
Inventory of Factors G-A-M-I-N 

Howard G. Martin 
Lo 8 Angeles, California 

Factor analysis methods have been applied to the problem of isolating 
independent variables of temperament with the result that several unitary 
traits have been identihed (3,4,5) and a aeries of inventories constructed 
which attempt to measure some of these traits (1, 6). 

The Guilford-Martin Inventory of Factors G^A-M-I-N adds five 
more temperament variables to the eight already covered by the two 
preceding tests of the series. The five traits included in the new inventory 
are: G, General pressure for overt activity; A, Ascendancy in social 
situations as opposed to subraiasiveness; leadership qualities; M, Mas¬ 
culinity of attitudes and interests as opposed to femininity; I, Lack of 
inferiority feelings; self-confidence; and N, Lack of nervous tenseness and 
irritability. 

Traits G, M, and N were discovered in factor analyses by Guilford 
and Guilford (3, 5) and trait I by Hosier (7). Traits A, M, I, and N 
have been recognized by clinical psychologists, though not always defined 
in the same manner. The definitions of the trait names as used in this 
connection are operational; that ia^ in terms of factorial studies and 
subsequent item analyses. 

More than 300 questionnaire items were constructed which were be¬ 
lieved to cover the areas of behavior constituting these five traits. This 
lisfcj stated in question form to be answered by either “Yes,” or 
"No,” was administered to 250 men and 250 women college students 
between the ages of 19 and EO, ran^ng from sophomores to seniors in 
southern California colleges and universities. 

The items which had been shown by the factor analyses and two pre¬ 
vious item analyses to have heavy loadings in a trait were included in the 
preliminary scoring key for that trait. Topical items from these keys are 
listed below: 

For trait G: 

Are you inclined to be quick in your actions? 

Can you turn out a large amount of work in a short time? 

A.re you inclined to rush from one activity to another without pausing 
for rest? 
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For trait A: 

Do you usually speak out in a meeting to oppose someone who you feel 
sure is wrong? 

Do you find it difficult to get rid of a salesman to whom you do not care 
to listen or give your time? 

Have you ever, on your own initiative, organized a club or group of any 
kind? 

For trait M 

Do you like love scenes in a movie or a play? 

Do you (or would you) like to go hunting with a rifle for wild game? 

Arc you disgusted at the sound of foul language? 

For trait I; 

Do you feel that the average person has made a better adjustment to life 
than you have? 

Do you feel confident that you can cope with most situations that you 
will meet in the future? 

Do you suffer keenly from feeliriga of inferiority? 

For trait N: 

Do you often become irritated over little annoyances? 

Do you have nervous habits such as chewing your pencil or biting your 
fingernails? 

Do you feel compelled to change your bodily poabure frequently while 
sitting? 

Four hundred of the questionnaires (200 males and 200 females) were 
scored with the preliminary scoring keys thus constructed. Tlie highest 
100 and the lowest 100 cases (extreme quarters of the distributions of 
scores) were used as criterion groups in the item analyses for factors G, A, 
I, and N. For the item analysis of factor M, the criterion groups con¬ 
sisted of the 100 male cases highest on the preliminary scoring key for the 
M factor and the 100 female cases lowest on the key. 

Scoring weights were found for each response to each item by using 
Guilford's abac method (2). This procedure yielded final scoring keys 
consisting of 41 items for trait G, 50 items for trait A, 52 items for trait M, 
64 items for trait I, and 68 items for trait N. Only nine items were scored 
for more than one trait. 


Table 1 

Intcrcorrelationa between Scoree of 100 Caeca 



G 

A 

M 

I 

A 

.61 




M 

.10 

.34 



I 

,30 

.54 

.43 


N 

-.27 

.10 

,34 

.70 


As a check on the reliability of scoring, the test papers of the remaining 
100 cases, including 50 males and 50 females, were scored with these final 
scoring keys, which, for the purpose, were divided into random halves 
of items, Pearsonian coefficients of correlation were computed between 
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the scores on these hElves of the scoring keys and, when corrected by the 
Spearman-Brown formuldj they became .89 for trait G, .88 for trait A, .85 
for trait M, .91 for trait I, and .80 for trait N. 

Intercorrelations between the scores derived by means of these scoring 
keys are shown in Table 1. 

The validity of tiait M was checked by comparing the distributiona 
on the trait scores of the 50 males and the 60 females which were not used 
in the item analyses. Ninety-two per cent (46 out of 50) of the males 
were above the median of the distribution of the 100 scores of the two 
sexes combined. Ninety-two per cent (46 out of 50) of the females were 
below the median of this distribution. The overlap was only 8 per cent 
of the 100 scores. Some males are more feminine in their reactions than 
some females and vice versa (8). That this difference in some oases may 
have a glandular condition accompanying it is demonstrated by the fact 
that one of the males who fell below the median on trait M waa found to 
have a history of hypogonadal function and infantile genitalia. 

These types constitute an undetermined percentage of the overlap in 
scores between the sexes in general. Therefore, the validity coefficient 
(phi) of .84 for trait M which was computed from these figures is as high 
as can be expected in view of the fallibility of the criterion. 

Recited July S9, IS^. 
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Measuring Progress in Radio Training 

(jordoEL 1. Macdonald 

New Yofk Vniifer^i^ 

In New York City the War Department in conjunction with the New 
York State Department of Education set up a school in 1942 to train radio 
technicians where the instruction was administered by various universities 
and radio schools. The course of instruction, lasting six months, was 
divided into two sections of three months each. It was within this edu¬ 
cational framework that the problem for this study evolved. 

This study grew out of the need for an adequate test to measure the 
progress of trainees under instruction. Specifically the problem is two¬ 
fold i (1) to develop an adequate instrument for measuring progress in 
training that would be valid and reliable at various levels; and (2) to apply 
the instrument to groups of trainees for the purpose of evaluating their 
progress and comparing results in the seveml institutions- 

This investigation included 1,150 Bubjects studying the theory and 
practice of radio servicing (how to repair radios). These subjects repre¬ 
sent three levels of general education: (1) High School Students, consisting 
of three groups of 28, 34 and 25 subjects between the ages of 16 and 20 
studying in a public vocational high school (These students were not in 
any way involved in the War Department training program and were 
included in this study for comparative purposes); (2) High School Gradu¬ 
ates, consisting of four adult groups of 126, 289, 326, and 216 students be¬ 
tween the ages of 18 and 40. This age limit was set by the War Depart¬ 
ment for radio trainees accepted for a course of study in a commercial 
radio school under the superviaon of the War Department and the New 
York State Department of Education; and (3) College Students of which 
there were three groups of 25, 30, and 34, with a mean age of 20 years, 
studying at three universities in New York State where their courses were 
limited to three months. 

The subjects comprising the two educational levels of adult High 
School Graduates and College Students, who were trainees of the Signal 
Corps, War Department, were chosen on the basis of a Civil Service 
aptitude teat and a physical examination by aiiny doctors, and they were 
further required to join the enlisted reserve of the Army of the United 
States. The group of College Students were further selected on the basis 
of their knowledge of higher mathematics and college physics. 
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There was no standardized objective achievement test in the field of 
radio available. However, an unstandardized test was discovered con¬ 
sisting of two forms, A and B, each containing 110 items and it was used 
and standardized in this investigation. It was a paper and pencil, mul¬ 
tiple choice, self administering, group achievement test with no time limit, 
but requiring from one hour and a half to over two hours for completion. 

The preliminary standardization was done at the level of High School 
Graduates of general education, and at two levels of specialized radio 
training. Group V with three monfcha' training, and Group VII with six 
months’ training were used in this phase of the study. 

As a result of these analyses two new forms of the test, revised Form A 
and Form B, were prepared consisting of the best 09 items from the 116 
of each original form. It is these forms which \v'ere used in the rest of 
this investigation, 

Training Progress Measured 

The revised forms were administered to various groups at three dis¬ 
tinct levels of general education to find out if progress in specialized radio 
training could be measured equally well with the test regardless of back¬ 
ground. Norms in radio training thereby can be made available taking 
into account any contribution of general alucation, 

High School Siicdenfs (Groups I, II, and III): The sub jecta at this level 
of general education had completed the 2^ years of general instruction 
of a public vocational high school and were in attendance on one of the last 
three terms of specialized radio instruction. They were tested at the end 
of 315 hours of radio instruction, or one term (Group I), at the end of 630 
hours of radio instruction, or two terms (Group II), and at the end of 945 
hours of radio instruction, or graduation (Group III). Both Forms A 
and B, with some exceptions, were administered to all members of these 
groups. 

The means, sigmas of distribution, and C.E.'s between the means on 
both forma, for the three groups, ate given in Table 1. 

The levels of specialized radio training are differentiated one from 
the other by both forms of the test as is indicated by the difference between 
the means; and these differences are significant as indicated by the critical 
ratios. 

High School Graduates (Groups IV, V, VI, and VII): The adult radio 
trainees who comprised this level of general education were all high school 
graduates. The groups were divided according to specialized training in 
radio as follows: Group IV being novices with no training; Groups V and 
VI being students with three months’ full-time training of 624 hours; and 
Group VII having completed the six months’ full-time course of training 
of 1,248 hours. 
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Table 1 


Progress in Specialized Radio Training at the General Educational Level of High School 
Students, Showing M, o- (diet.), for Each Lc^l, and C.R.’s between Levels 
of Specialized Training Separately for FormB A. and B 


Ponn A 

Training Period 

Group Mean 

(T (diet,) 

N 

One term (315 hours) 



28 

Two terms (030 hours) 



34 

Three terms (045 hours) 

HI 60.92 

■EH 

25 

Critical Ratify 

One term (316 hours) vs. two terina (030 hours) 


2.75 

One term (316 hours) va. 

three terms (046 hours) 


7.00 

Two terms (030 hours) ve 

1 , three terms (046 hours) 


3.81 

FormB 

Training Period 

Group Mean 

<r (dist.) 

N 

One term (315 hours) 


5.70 

26 

Two terms (630 hours) 

n 48.00 


34 

Three terms (fl45 hours) 

m 61.05 

9.03 

26 

Critical Ratios 

One term (315 hours) vs. 

two terms (030 houiu) 


3,70 

One term (316 hours) va. 

I 

1 

§ 

O 

V 


10,93 

Two terms (630 hours) vs. tlmee terms (945 hours) 


0.10 


The means, gigmaa of distribution, and C.R.’s between the means for 
aif groups on both forms are given in Table 2. 

It is evident from the means ^ven in Table 2 that the three levels of 
specialized radio training of "no training,” "three months' training,” and 
"six months’ training” are distinguished one from the other. The critical 
ratios indicate that the differences between the means of the two groups 
with three months’ training (Groups V and YI) are statistically insignifi¬ 
cant, while the differences between the means for the other levels of spe¬ 
cialized training are highly significant, these values holding for both forma 
of the teat. 

The results with Form A (Table 2) show that the difference between 
the means of the two groups tested at the end of three months of spe¬ 
cialized radio training (Groups V and VI) is statistically insignificant, 
the C.R. being 1.36. The C.R. between the thi’ee months' ti-aining level 
(Group V) and the six months' training level {Group YII) is 10.57, and 
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the C.R. between the three months* training level (Group VI) and the six 
montha' training level (Group VII) is 9.39. Thus Form A distinguiahes 
clearly between levels of specialized training in radio among higlr school 
graduates. 

The results for Form B are similar. The novices, or those with no 
training (Group IV) are distinguished from the others quite significantly 
with C.R.’s of 14.08 and 14.74 in comparison with the two groups with 
three montha’ training (Groups V and VI); and with a C.R. of 20.12 
between them and those at the six months’ training level (Group VII). 
The C.R. of the means of the two groups with three months’ training 
(Groups V and VI) is statistically insignificant, as on Form A, while the 
G.R.'s of the means between these same groups at the three months' level 

Tabic 2 


Progress in Specialized Uadio Training at the General Edncallonal Lovol of High School 
Graduation, Showing M, a (disl.), for Each Level, and C.R,'a between Levels 
of Specialized Training Separately for Forma A and B 


Form A 

Training Period 

Group 

Mean 

ff (dial,) 

N 

Thteo months 

V 

48.80 

0.66 

144 

Three months 

VI 

50.35 

10.32 

102 

Six months 

VII 

62.05 

13,43 

107 

Critical Ratios 

Three montha (624 hours) Group V 

•VB. Three montlia (024 hours) Group VI 


Three months (024 hours) Group V 

vs, Six months (1,248 hours) Group VII 

10.67 

Three months (624 hours) Group VI 

VB. Six montha (1,248 hours) Group VH 

9.30 

Form B 

Training Period 

Group 

Mean 

7 (diat.) 

N 

No training 

IV 

27.30 

12.25 

126 

Three montha 

V 


g.92 

145 

Three months 

VI 

47.36 


164 

Six montha 

VII 

60.30 

12.77 

100 

Critical Ratios 


Ho training Group IV va. Tliree montlia (024 hours) Group V 14.09 

No training Group IV vs. Three montha (024 houra) Group VI 14.74 

No training Group IV va. Six montha (1,248 houra) Group VII 20,12 

Tlu:ee months (ft24 hours) Group V vs. Three montha (624 hours) Group VI .64 

Three montha (624 hours) Group V vs. Six months (1,248 houra) Group VII 9.26 

Tliree montlia (624 hours) Group VI vs. Six mouths (1,248 hours) Group VII 8.87 
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Table 3 

Progrcsa in Specialized Radio Training at the General Educational Level of Collogo 
Studente, Showing M, a (dietOi for Each Level, and C.R.'b between Levels of 
Speciolized Training Separately for Forma A and B 


Form A 


Training Period 

Group 

Mean 

a (dist.) 

N 

Two montha (416 hours) 

IX 

65.12 

6.03 

28 

Three months (024 hours) 

vm 

74.12 

9.30 

25 

Three montha (624 hours) 

IX 

76.00 

0.61 

30 

Three months (624 hours) 

X 

70.09 

12.00 

34 

Critical Ratios 

Two months (416 hours) Group IX 

va. 

Thn» months (624 hours) Group VIII 

3.27 

Two months (410 hours) Group IX 

VB. 

Three months (024 hours) Group IX 

4.18 

Two months (410 hours) Group IX 

va. 

Three months (624 hours) GroupX 

3.92 


Three montha (024 hours) Group VIII va. Three months (624 hours) Group IX .64 

Three months (024hoiirfl) Group VIII va. Three months (024 hours) Group X .71 

Three months (024 hours) Group IX vs. Three montlis (624 hours) Group X .22 


FormB 

Training Period 

Group 

Mean 

ff (dist.) 

N 

One month (208 hours) 

IX 

31M 

6.13 

28 

Threo months (024 hours) 

VIH 

69.66 

8,73 

26 

Three montha (624 hours) 

IX 

75.10 

10.05 

30 

Three months (624 hours) 

X 

73,64 

12.66 

34 

Crilical Ratios 


One month (208 hours) Group IX vs. T^ireo montlis (024 hours) Group VIII 16.48 


Ono month (208 hours) Group IX vs. Three months (024 hours) Group IX 18.38 

One month (208 hours) Group IX va. Three montha (624 hours) Group X 16.03 

Three montha (624 hours) Group VIII vs. Three montha (024 hours) Group IX 2.05 

Three months (024 hours) Group VIII va. Three months (624 hours) Group X 1.40 

Three months (624 hours) Group IX va. Three months (624 hours) Group X .64 


of training and that of the group with six months’ training (Group VII) 
are statistically significant, being respectively 0.26 and 8.87. Thus spe¬ 
cialized training levels are clearly differentiated by both forms at the 
general level of education represented by High School Graduates. 

College Students (Groups VIII, IX, and X): The radio trainees com¬ 
prising this level of general education received their specialized radio 
training at three universities in New York State, the course lasting for 
three months or 624 hours of instruction. The groups are distinguished 
from each other according to the university which they attended, Group 
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IX wag tested at the end of one month’s training with Form B, at the end 
of two months’ training with Form A, and at the end of three months’ 
training with both Form A and B. Groups VIII and X were tested nt 
the end of three months’ training with both forms. 

Tlie means and sigmas of distribution of both forms at the different 
levels of speeiall 2 ed training, and tl\e C.R.'s indicating the statistical sig¬ 
nificance of the difference between levels of training are given in Table 3. 

The means indicate that the levels of 8 peciali 2 cd training at one, two, 
and three months are differentiated from each other. The differences on 
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Fig. 1. Levels of radio traiiting, Bhowing M, one <r, and range in scores on Form A 
for various amouata of radio traioing clossifiod according to levels of general education. 


Form A at two and three months’ training are stfitistically aignificaiit: a 
C.R, of 3.27 existing between Group IX and Group VIII; one of 4,18 for 
Group IX; and one of 3.92 between Group IX and Group X. 

The data for Form B show that the differences between moans at one 
month's training (Group IX) and thi-ee months' training (Groups VIII, 
IX, and X) are highly significant, the C.R. being 16.48 between Group 
IX and Group VIII; 18,38 for Group IX; and 15.63 between Group IX 
and Group X. 
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The C.R.'s of the means for the groups compared at the three months’ 
level of training are statistically insignificant in all cases, This statistical 
insignificance of the differences between the means coupled above with 
the evidence of reliable differences between different levels of specialized 
radio training, indicates that the teat is measuring progress in training. 

Progress in radio training is being measured within different levels of 
genez’al education. Differences between levels erf specialized training hold 
for both forms of the test. A graphic representation of these results ia 
given in Figures 1 and 2, 

SaorflB 

0-in BO—3D-10—50 CD—70 5a '~‘0P~ W 

}n.^ School StiHenta 


School OrBOuitM 


1 


Cella^ Students 


3 moat < 

(Group mi) ’ ■ 

3 moa, I 

(Group IX) 

.. 3 no8i ■ - - 

(Group X) 

ro lo on an ca E.Q fif. 70 flft flo og 
Sooroa 

Fig. 2, Levels of radio training, showing M, one i:, and range in scores on Form D 
for various nmounta of radio training classiGed according to levels of general education. 

Analysis of Reliability and Validity 
The measurement of progress having been indicated the next step was 
to check the equality of the fonna and verify the reliability at the various 
levels of specialized radio training, and the different levels of general 
education; and to establish the validity of the test. 

Equality of ike Porms. The two fonns were compared at the different 
levels of specialized radio training within the levels of general education, 
Both forms were found to be equal in difficulty, with variability of per- 
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formance being much the same lor both forms, "with the exception of 
Group I at the general education levd of High School Students, per¬ 
formance on Form A being slightly more variable.^ 

ReUahility. The odd-even correlations, corrected by the Brown- 
Spearman formula for length, for all groups tested are given in Table 4. 
The parallel form correlations for those groups which wore tested with 
both forms la given in the same table. 


Table 4 

Oild-Evdn and Parallel Form Correlation at AU Levels oC General Education 


Odd-Even CorrnlatloDfi 



Form A 



Form B 


Training Period Raw roe 

P.E. 

roe* 

P.E. 

Raw To* 

P.E. 

Toe* 

P.E. 

Group I 

.63 

.QQ 

.69 

.07 

.63 

.00 

.69 

.07 

Group II 

.S2 

.04 

.00 

.02 

.51 

.09 

.07 

.07 

Group III 

,80 

.04 

.88 

.03 

.88 

.03 

.03 

.02 

Group IV 





,80 

.02 

.89 

.01 

Group V 

,70 

.03 

.83 

.02 

.00 

.03 

,81 

.02 

Group VI 

.33 

.03 

.78 

.02 

.07 

.03 

.80 

.02 

Group VII 

.84 

.02 

.01 

.01 

.82 

.02 

.00 

.01 

Group IX (1 month) 

Group IX (2 months) 

.54 

.06 

.70 

.06 

.74 

.04 

,86 

.03 

Groups VIII, IX, ondX 

.80 

,01 

.03 

.01 

.89 

.01 

.94 

.01 

* Corrected by Brown-Spearman formula. 





Parallel Form Correlations 


Training Period 





r 


P.E. 


Group I 



28 


.30 


.11 


Group II 



34 


.73 


.06 


Group in 



25 


.44 


.11 


Group VIII 





.87 


.03 


Group IX 







.05 


Group X 



34 


.02 


.02 


Groups VIII, IX, and X 


m 


.88 


.02 



High School Siudenta (Groups I, II, and III); The groups at the lowest 
level of high school training (Group I) have an odd-even r of .69 on both 
forms. This reliability is unsatisfactory at this lowest level of specialized 
training and level of general education. 

^ In an effort to save space the tables for this analysis have been omittod, but they 
may be obtained from the author. 
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The parallel form correlation of .39 for this group is likewise quite low, 
and ia not four times its P.E. Thus any prediction of individual perform¬ 
ance on one form aa compared to individual performance on the other 
would likely be no better than chance for members of this group, 

The group at the next level of training (Group II) has a reliability 
coefficient of .90 that ia satisfactory on one form while on the other it is 
much lower (.67) and unsatisfactory. The parallel form correlation is, 
however, high enough to be acceptable. 

The group at the highest level of radio training among high school 
studenta (Group III) has reliability coefficients that are acceptable on 
both forms of the test. However, the parallel form correlation of .44 is 
quite low and just four times its P.E. 

High School Graduates (Groups IV, V, VI, and YII): The reliability 
coefficients on both forms for all of the groups at the various levels of 
specialized training indicate that the reliability of the two forms is gen¬ 
erally satisfactory at this level of general education. 

College Students (Group VIII, IX, and X): The groups with three 
months’ training were combined on one Pearson Product-moment chart 
for purposes of computing the odd-even correlation because it was shown 
that their training was apparently identical as indicated by the means of 
all groups on both forms. 

The odd-even correlation (Form A) at the two months’ level of spe¬ 
cialized training ia lower than for the other levels, with the reliability 
coefficient for three months’ training being most satisfactory. The 
parallel form correlations for the vorioua groups at the three montlis’ level 
of specialized training are quite satisfactory and indicate that prediction 
of individual, and group performance from one form to the other would 
be highly reliable. 

The reliability as shown by the odd-even correlation is acceptable at 
all levels of specialized radio training, with the exception of the first term 
students (Group I) at the high school level of general education. • The 
parallel form correlation at the general education level of High School 
Students is not as reliable as at the general education level of College 
Students where the coefficients are acceptable for group and individual 
prediction. 

Validity. The progress made in specialized radio training was an¬ 
alyzed at three levels of general education, and within those levels groups 
were differentiated one from the other by the means according to progress 
in specinJized radio training. Those diffemaces between the means for 
the various levels of specialized radio training within each general educa¬ 
tional level was shown to be statistically significant, and was statistically 
insignificant between groups with specialized radio training. This dis- 
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tinguiahing between levels of specialized radio training indicates a valid 
test of radio achievement. 

Another indication of validity is to be found in the low correlations 
whioh were found to exist between the radio achievement test and the Otis 
Intelligence test, Groups VIII and X were administered the Otis In¬ 
telligence Test, Higher Examination Form B, timed for thirty minutes 
and scored for the number right, and the results correlated with both forms 
of the radio achievement teat. Group VIII Jiaa a correlation of —.03 
between Form A of the radio achievement teat and tlie Otis Intelligence 
Test and .20 between Form B and the Otia Test; and for Group X a cor¬ 
relation of .05 was obtained between Form A and the Otis Teat and ,02 
between Form B and the Otis Test. Thus we have indicated by the low 
correlations, approaching zero in three instances, that there is being 
measured by the radio achievement teat some capacity tliot is different 
from that defined capacity measured by this standardized and valid 
intelligence teat. 

There being no known acceptable outside criteria with which this test 
may be correlated, the evidence of parallel form correlation is offered 
in its stead. Each form of the radio achievement test at the general 
education level of College Students has a high self correlation, and each 
form correlates high with the other form. Both forms of the radio 
achievement test may be said to be valid radio achievement tests and they 
are measuring equally well that capacity which, for this study, is known 
as radio knowledge. 

Summary end Conclusions 

The purpose of this investigation was to measure training progress of 
radio learners, and bo standardize the instrument thus used. 

Three levels of general education were represented in the subjects 
selected for measurement of radio training: High School Students, High 
School Graduates, and College Students. The subjects at the two highest 
levels of general education were selected from male applicants on the basis 
of a Civil SeiwicQ Aptitude test and a physical examination by Army 
doctors. 

A preliminary standardization of two forma of a radio achievement test 
was made; the two forms compared for difficulty and variability of per¬ 
formance; odd-even correlation computed for reliability, and a bi-serial 
correlation of test items computed for the two forms. On the basis of this 
work the test was revised and the forma reevaluated. Both forms wore 
found to be close to equality of difficulty and variability of performance. 

The two forms of the test were administered to each member of three 
groups, with one, two, and three terms of radio training, at the general 
educational level of High School Students. At the general educational 
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level of High School Graduates oae form (Form B) waa administered to a 
group of novices, and both forma were administered in alternate faahion. 
to the members of the other groups. At the general educational level of 
College Students the two forma of the test were administered to all 
members of the three groups; while one group (Group IX) was tested with 
Form B at the end of one month, and Form A at the end of two months 
of radio training. 

Answers to the following questions were sought from the data thug 
accumulated; 

1 . Are both forms of the test reliable at various levels of radio training 
within the several levels of general education? 

2. Is this a valid test of radio achievement? 

3. Are the two forms equal in difficulty and variability of performance 
for various levels of specalized radio training within each general 
educational level? 

4. What prediction of an individual's or a group’s progress in training 
exists for either form? 

The answers to these questions are the conclusions derived from this 
study. 

1. The test is a reliable test as is indicated by the odd-even and parallel 
form correlations shown in Table 4. The odd-even reliability coefficients 
range from .69 to .93 on Form A and from .67 to .94 for Form B at the 
various levels of specialized radio training with a median coefficient of .88 
for Form A and .86 for Form B. The lowest reliability coefficients were 
at two levels of specialized radio training within the general educational 
level of High School Students where the odd-even correlation was .69 for 
the lowest group (Group I) on Form A and .67 for the middle group 
(Group II) on Form B. The parallel form correlation for Group I was 
.39, and .44 for Group HI. It appears from this that the teat is leas 
reliable at the lowest of the three levels of general education. 

2. The test appears to be a valid test of radio achievement at various 
levels of specialized radio training and general education. The magnitude 
of the parallel form correlations suggests this as shown in Table 4. The 
low correlations between both forms of the t^t and an intelligence test is 
evidence that the test is measuring some factor other than intelligence, 
which is assumed to be radio knowledge as that was what the students 
were studying, and that was what was tested. Essentially however, the 
test is valid because it differentiates between levels of specialized radio 
training within each of three levels of general education, and with dif¬ 
ferences between the mean levels of specialized training that are practi¬ 
cally without exception statistically significant as shown in Tables 1, 2, 
and 3. 
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3, The two forma are close to equality of difficulty at all the higher 
levels of specialized radio training for all general educational levels, with 
Form B slightly more difficult at the lowest levels of specialized training. 

4, The coefficients of correlation between levels of specialized radio 
training at the general educational level of College Students (Group IX) 
were of such magnitude (.G2 to ,82) aa to be acceptable for group predic¬ 
tions of training progress; and individual prediction as indicated by these 
same coefficients is increased from 20% to 40% above chance at the 
various levels of specialized radio training. 

In general, it appears that specialized radio training is affected some¬ 
what by the level of general education (see Figures 1 and 2). 

Thus it may be concluded that training progress of radio trainees has 
been measured and a test has been standardized to accomplish it. 

Receivid A\igufil 7,1944- 



A Study of the Effect of Music Distraction on 
Reading Efficiency 

Mack T. Headerson, Anne Crews, and Joan Barlow 

GrinTwH CdlUge, Icnoa 

Very often coliege students claim that they can study effectively with 
the radio on, that music does not “bother” them. This suggested the 
following study which attempts to determine whether or not reading 
efficiency ia influenced when music is used as distraction, and whether 
there is any difference in the influence of popular and classical music upon 
reading efficiency. In a aimilar study Paul Fendrick ‘ found that semi- 
clflfisicoJ music tended to reduce efficicnoy, but since he did not equate his 
groups and because he used only one type of distraction, it was decided 
to supplement his results through this experiment. 

Procedure 

Fifty frcahman women helped us with this experiment. These women 
were divided into three equally matched groups on the basis of their 
psychological examination scores (American Council on Education Psy¬ 
chological Examination, 1942 edition) and reading test scores (Nelson- 
Denny Reading Teat) obtained in September, 1943. The A.C.E. means 
for the No Distraction, Classical, and Popular groups were 107.7 ± 22.6, 
102.B ± 30.3,103,6 ±23.8. The means for the vocabulary section of the 
reading test were 43.1 ± 16.1, 42.6 ± 16.7, 43.8 ± 13.5, and for the 
paragraph section of the reading test 46.3 ± 11.B, 47.3 ± 11.7, 48.0 
± 13.9. The differences in these means were found to be statistically 
insignificant as measured by Pisher t. 

First of all, the subjects filled out a questionnaire which was con¬ 
structed primarily for the purpose of determining whether or not the 
subjects were accustomed to studying with the radio on; whether or not 
they thought that the radio reduced their study efficiency; the amount of 
studying done with the radio on; and the type of program they usually 
listened to when studying. 

The Nelaon-Denny Reading Test woe used in this study to measure 
the reading efficiency of the three groups- This test was chosen for four 
reasons; (1) it has two forms which made possible the use of one form as 

* Pendriokp P. The ioBuoncd of music dictracbon upon rofldiog oificiency. J . educ. 
Re$., 1937, 31, 264-271. 
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a pre-tesfc and the other as a final teat; .(2) Form A had been given to the 
freshmen when they entered college, September, 1043, making pre-test 
sDorea immediately available; (3) the test has two sections, a vocabulary 
section and a paragraph comprehension section, making it possible to 
determine the influence of distraction upon these subdivisions as well as 
upon the total scores; (4) the test required only 30 minutes to complete, 
10 minvites for vocabulary and 20 for paragraph comprehension, 

Form B of the Nelaon-Denny Reading Test was administered, as the 
final test, to a group of 14 freshman women with popular music as distrac¬ 
tion and to a group of 17 with classical music as distraction, while a third 
group of 19, a control group, took the reading examination without any 
distraction. Hereafter, these groups will be referred to as Popular, Clas¬ 
sical, and No Distraction groups. Popular and classical music were the 
two types of music chosen for this study, because the questionnaire results 
showed that they were the two types to which roost of the subjects usually 
listened. Typical, familiar recordings of both types of music were care¬ 
fully selected to be played during the tests. The recordings used in this 
experiment are as follows: 

Musical Recordings: Popular music (order of presentation); 1, Two 
O'clock Jump (Harry James); 2. That’s What You Think (Krupa); 
3. Sunday, Monday, or Always (Frank Sinatra); 4. Mr. Five by Five 
(Harry James); 5. Prince Charming (Harry James); 6. Tuxedo Junction 
(Glenn Miller); 7. Idaho (Benny Goodman); 8. Crossbown (Glenn 
Miller); and 9. Close to You (Frank Sinatra), and Classical music: 
Symphony in D Minor by C^sar Franck (Philadelphia Symphony 
Orchestra, Victor Recording, 6726-6730). 

The conditions under which the tests were given were regulated as 
carefully as possible. The tests were administered on three successive 
afternoons at hours when the greatest number of the subjects would be 
free. However, it was impossible to find times when they were all free; 
hence, the rather small number of subjects. During the test, the subjects 
were asked to assume that they were in their own rooms studying with 
the radio on. The volume of the phonograph wag predetermined by a 
group of judges, including students, and regulated to approximately the 
same loudness which the subjects ordinarily maintained when studying 
with the radio as background. These judges, who were stationed at 
various places in the room in which the tests were to be given, agreed 
upon the loudness desired. In order to assure some measure of similarity 
of volume, the position of the volume control was noted and used through¬ 
out the experiment. This method was resorted to, because a physical 
device for determining volume in decibels was not proctical, since the 
volume within each record varied noticeably. 
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The significance of the differences in the means was determined by the 
Fisher t test. 

Results 

In Table 1 are recorded the averages of the No Distraction, Classical, 
and Popular groups, the differences between the averages of the pre-test 
•scores and the final test scores of each group, and the significance of these 
differences in averages. It will be observed that the only score influenced 
by the distraction more than could bo accounted for by chance is the 


Table 1 

Nelson-Dciiny Averagea and I Scores 



N 

Pre-Tcat 
(Form A) 

Final Teat 
(Form B) 

Difference 

1 

(Fialier) 

P 

No DistrivcLion 
vocabulary 

19 

43,1 

50,0 

+6.9 

1.260 

.20 

paragraph 


45.3 

49.2 

+3.9 

.Q23 

,35 

ClaEsical 

vocabulary 

17 

42.6 

48.4 

+6.8 

.900 

,36 

paragraph 


47.3 

4Q.1 

-1.2 

.206 

.80 

Popular 

vocabulary 

14 

43.8 

47.8 

+4.0 

.605 

.65 

paragraph 


4B.0 

22.9 

-26.1 

6.160 

<.001 


paragraph score of the Popular group. This score was reduced 25T score 
points, on the average, below the pre-teat score. It is interesting to note 
that the vocabulary scores of all three groups showed an increase even 
though the increases are not statistically significant as measured by 
Fisher t. 

In order to determine whether or not differences exist between those 
who are accustomed to studying with the radio and those who are 
unaccustomed to studying with the radio, the data of Tables 2 and 3 are 
presented. These data show that, regardless of the students’ study 
habits, the groups function alike. The paragraph scores of the Popular 
group showed a significant decrease in the final teat score whether students 
were accustomed to studying with the radio or not; all other test score 
changes were within the range expected by chance. 

In trying to account for the lack of influence or distraction of classical 
music upon the test results and the lack of influence of popular music upon 
the vocabulary scores, one can only suggest explanations, A. reasonable 
explanation for the lack of distraction of classical music is that the rhythms 
and melodies of classical music are usually more complex and less obvious 
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Table 2 

Nclson-Denny Averages and t Scores of Those Who Dse the Radio When Studying 



N 

Pro-Test 
[Form A) 

Final Teat 
(Form B) 

Diffctonco 

1 

(Fiahot) 

P 

No Distraction 

14 






vocabulary 


42.3 

40.8 

+7.5 

1.080 

.30 

paragraph 


44.1 

48,0 

+4.8 

1.062 

.30 

Classical 

& 






vocabulary 


41,4 

60.4 

+0.0 

1.341 

.20 

paragraph 


47.8 

40.g 

-.9 

.134 

.65 

Popular 

& 






vocabulary 


45.5 

50.6 

+5,0 

.670 

.60 

paragraph 


53.8 

25.1 

-28.0 

5.465 

<.001 



Table 3 




Nelflon-Donny Averages and t Scores of Those Who Do Nob Use 




tho Radio When Studying 





Pre-Test 

Final Teat 


t 



N 

(Form A) 

(Form B) 

Difference 

(Fisher) 

P 

No DistraotioD 

5 






vocabulary 


3e.8 

40.8 

+3.8 

.531 

.00 

paragraph 


3d.6 

40.0 

+.4 

.042 

.96 

Classical 

8 






vocabulary 


43.3 

40.1 

+2.8 

.246 

.80 

paragraph 


40.8 

46.3 

-1.6 

,201 

.85 

Popular 

6 






vocabulary 


41.6 

44.2 

+2.7 

.244 

.80 

paragraph 


40.3 

20.0 

-10.7 

3.849 

<.001 


than those of popular music. The eimpler and obvious rhythms and 
melodies of popular music are easily grasped by a group of subjects and 
are therefore listened to by the subjects. Naturally, while they listen to 
the music their attention is diverted from the task at hand. Classical 
music with its subtle rhythms and hidden melodies is apt to be vague and 
is therefore not “listened to.” It becomes a background against which 
the assigned task is accompliehed without interference, and under these 
conditions it does not divert the subject's attention from his work. Just 
what a group of persons highly trained in the understanding of classical 
music would do under the conditions of this experiment remains to be 
determined. 
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Effect of Music Dislraclion on Reading Efficiency 

A likely explanation for the fact that popular music iufluencea the 
paragraph scores and not the vocabulary scores seems to lie in the nature 
of the test materials. The paragraph materials are meaningfully related 
and require Qiistained effort on the part of the subject. In contrast to 
this, the vocabulary materials are intermittent and unrelated. This sug¬ 
gests that popular music interfered with the more complex of the two test 
sections. 

The suggested explanations might be summarized by saying that 
whether or not music is a real distraction depends upon the complexity of 
the music and upon tlie complexity of the test materials. In this experi¬ 
ment, the subtler music (classical) did not influence the test results, and 
the obvious music (popular) influenced only the paragraph section of 
the test. 


Conclusions 

1. Popular music distracted a group of subjects significantly on the 
paragraph section of the Nelson-Denny Reading Test. Classical music 
showed no evidence of distraction in either the vocabulary or paragraph 
sections of the test, nor did the popular music show evidence of distraction 
upon vocabulary. 

2. Students accustomed to studying with the radio were influenced as 
much or as little as students unaccustomed to studying with the radio, 

3. It is suggested that whether or not music serves as a distraction 
depends upon the complexity of the music and upon the complexity of 
the teat materials. 


toit/ed June 194^. 



Book Reviews 


The lengthof ft review of abookor moaopaph iano indication of ita importance. 
Because of W.P.B. restriotions on paper roviewera of books have been requested to 
prepare their reviews in fewest possible words. Ed, 

Halaey, George D. MaJting and winp indvHrial service raiinffs. New York; 

Harper & Bros., 1944. Pp. xxii 149. 12.60. 

‘This book is intended primarily for operating and personnel oxecutives 
who are interested in the practical aspects of service ratings—what has been 
done, what the difficulties lare, and how rating problems similar to theirs have 
been worked out successfully by other executives-" The book, however, 
contains material of value to anyone interested in employee ratings. 

Ratings of nonsupervisory, supervisory and executive personnel are dia- 
cusBed. Numeroua helpful excerpts and sample forms are presented, mostly 
from the field of public personnel administration, 

The author gives proper emphasis to such practical points aa how to train 
aupetviaots to rate employees and to diacuaa the ratings with the individuals. 

"Service ratings have two distinct and different purposes; to servo as an 
aid in training and supervision, and to furnish an evaluation of the person's job 
performance as an aid in making sound administrative decisions—salary in¬ 
creases. layoffs, etc." In developing a rating plan it is important to distinguish 
carefully between these two purposes. The rating procedure will differ in mony 
respects depending on whether it is designed to servo one or both of these 
^iUrpoaea. 

The efficiency rating system of the federal government is explained in con¬ 
siderable detail. It is evident that this plan is superior in every way to the 
graphic rating scale used almost universally in industry. 

With regard to the problem of scoring a rating form, the approach is both 
laborious and naive- From an attempt to attach numerical grades to employee 
ratings problems arise which cannot bo overcome in a practical situation. Logi¬ 
cal and statistical considerations, which the author completely overlooka, pre¬ 
vent one from obtaining a total score "by adding the numerical values of the 
ratings on the separate qualities.” There is a wide-spread misconception on 
this point among industrial people. It is not clear why it is necessary to grade 
the ratings in order to serve the training ox administrative purposes outlined 
above. 

It is unfortunate that the book does not touch on the problem of using 
employee ratings in a unionized organization. The broader problem is how 
can the merit of certain individuals be appraised and rewarded under conditions 
of collective bargaining. 

This book is a worthwhile contribution, to the Uteraturo on rating industrial 
employees. Although the approach is not scholarly, most of the content is 
sound and, above alt, it ia reafistic. 

Cliarleg C. Gibbons 

Owens-ltlinois Olaes Co,, 

Toledo, Ohio 
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Casonj Eloiae Booker, Mechanical methods for increaainff the speed of reading. 

An Experimental Study al the Third Grade Level. New York: Columbia 

Univereity Contributiona to Education, No. 878, 1943. Pp. 80, $1.75. 

This monograph ia a complete report of an experiment set up to answer a 
specific question for a specific group of subjects: Does intensive training in cor¬ 
rect eye movements improve measurable reading skills to a greater extent than 
would the use of the same amount of time for free library reading? The experi¬ 
ment is admirably designed to produce an unequivocal answer. Paired groups 
of third grade children (25 pairs in School A, 26 pairs in School B) were used as 
subjects. Pairing of individuals was based on scores from the Gates Reading 
Survey Teat, but Tables 1 and 2 indicate that the groups were closely similar 
on the Otis Intelligence Test as well. Twenty-minute training periods were 
scheduled five times a week for four weeks under the direction of the regular 
teachers, no other rending instruction being given during the experiment. In 
School A, experimental subjects read printed material marked and spaced to 
call attention to phrases. Control subjects rend library materials in the same 
room. In School B, experimental subjects practiced with the Metron-O-Scope. 
Control subjects read library materials in another room. Before and after the 
four-week training period, the Gates Reading Survey Teats end several now 
testa specially constructed to measure skill in the reading of phrases were given. 
Results bearing on the main problem were definite and clear-cut. In neither 
school viaa there a atatiatically significant difference on any test between the means 
of (he experimental and control groups. 

The data were then analyzed in aevernl other ways. In order to throw light 
on the question as to whether the efifecte of method may differ for children of 
different ability levels, each group was divided into upper, middle, and lower 
thirds. Since this would place only about eight or nine persons in each sub¬ 
group one would anticipate difficulty in demonstrating that any differences In 
sains were statistically significant. 'Therefore, it is interesting to find, using 

t-test, that a few were. In the School A Phrase Materiel Group, the upper 
third lost in speed while the middle third gained. In the Metran-O-Scope 
Group the upper third gained significantly more in comprehension than the 
lower third. In the School B Library Group, the middle third gained signifi¬ 
cantly more in comprehension than the lower third. Though results baaed on 
so few cases cannot be conclusive, they suggest the desirability of special 
investigation of this problem. Another sort of nnalyeia used the results of_a 
re-administmtion of the Gates Test after summer vacation. There were still 
no reliable differences between equated groups. It Reemed to this reviewer 
that the most interesting difference in the whole study was one which the author 
declined to interpret because of uncontrolled factors in the two situations, 
namely the difference between schools in gains on the Gates Test. In School A 
there were no significant gains for either group. In School B, both experimental 
and control groups showed gains of one-half to three-fourths of a year of reading 
age, gains which persisted over the summer vacation period. When one re¬ 
members that the practice periods added up to loss than seven hours altogether, 
these figures seem very large. Whatever the uncontrolled factors were which 
accounted for this result in School B may well be of more practical importance 
than the factors tho experiment was set up to test. 

There are a few places where the statistical explanations are a little obscure, 
but there seem to bo no errors in procedure which would oast doubt on the 
dependability of the results. Tlie findings of tho study as a whole will lend 
support to the arguments of those who hold that mechanical and motor skills 
are less important aspects of reading than ore intelleptual and motivational 
factors. Since free reading is much simpler and leas expensive than the me¬ 
chanical methods, the results should have definite practical application, 

Leona E. Tyler 


University of Oregon 
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Sargent, S. Stanefeld. The basic teachings of the greal-psychologials. New York; 

New Home Library, 1044. Pp. xiv + 346. $.69. 

The book covers about all the major topics in psychology with a pretty (ait 
balance. It includes most of the applied field aa well na the general field, but 
the former is usually somewhat implicit in tlio discussions of tlio latter rather 
than being set off by itself as applied psychology. In each chapter the treat- 
meat is essentially chronological, comprising a brief summary of the findings or 
theories of quite n number of people on the topic under coneidcration. The 
treatment is not critical, and the controversial questions arc loft open, 

The author indicates that it is written for the layman and secondarily per¬ 
haps aa a refresher for advanced students. The reviewer beliovca that these 
two markets should be reversed in importance. Tho layman will find tho dis¬ 
cussion somewhat cluttered by the names of so many people unfamiliar to him, 
and he will not find on extensive topic in which ho might be interested treated 
at any length. It is, of course, impossible to cover so much ground in any very 
systematic fashion. Occasionally, too, some technical term is introduced with¬ 
out any explanation, although later in the book it may be discussed in more 
detail, On tho other hand, the advanced student might find it quite helpful as 
a sort of thumbnail review of the whole field, and he would bo almost certain 
to encounter some bits of information here and there that would be a helpful 
supplement to his existing knowledge on a topic, The author must have cov¬ 
ered a tremendous amount of source material in order to formulato tho concise 
paragraphs which he does oa so many topics by so many people, From that 
standpoint the job is well done. 

The title of the book is subject to oriticism. There certainly are not aa 
many "great^' psychologists aa {rated. Tfie biographicaf notes at the end 
include some two hundred payohologiata. It ia probably not the author's fault, 
but the publisher’s blurb on the icoket is in poor taste and smacks of "gold 
brick.” 


Ohio Stale University 


Harold E, Burfct 
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Psychology: Principles and applicaiions. T. L. Engle. Yonkers-on- 
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1945. Pp. 154. $2.00. 
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Duell, Sloan & Pearce, Inc. $3.00. 
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Problems of the postwar world. A aympoaium edited by Thomas C. T. 
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The Measurement of Supervisory Quality in Industry * 

Quentin W. File 

Purdue UnivtTsily 

In any organizaiioii engaged in a productive activity there must be 
individuals wlio assume responsibility for directing productive procedures 
at the operational level. The Army has its sergeants; the school, its 
clnssroom teacliers; and the church, its ministeis and priests. Industry, 
likewise, must vely on its all-important directors of operations, its 
supervisors. Upon these supervisors rests the responsibility of seeing 
that all the creative planning, technical research, and personnel policies 
bear tangible fruit in the form of maintained or improved productivity. 
Operating supervision is the connecting link between top management 
and the worker, and the chain of harmonious industrial relations can 
be no stronger tlian this key link. 

In order to establish a common basis of understanding, let us define 
an industrial supervisor as an individual who actually directs the pro¬ 
ductive processes at the scene of opemtion. Such a definition would 
include individuals between the group leader and departmental supervisor 
levels, 

To meet the wartime demand, supervisory training programs have 
been instituted both by industry and by the government. Most of the 
training has been carried out on an “on-the-job” basis bo as to provide a 
minimum of intcrferGucc with regular work activities. In spite of the 
extensive publication.^ describing the various types of training progi-ams 
and testifying to the merits of each, little has been said about the need 
for objectively cviihiating the outcomes of such programs or about setting 
up a systematic method for evaluating supervisory quality. 

* This article is based on the ftiilhor’s thesis of the aaxnc title, submitted to the 
I’aculty of I’ui'due University in partial fulfillment of the rcquivcincnta for the degree of 
Doctor of Philosophy, June, 19-U. This study wua carried out under tlie dircelion of 
Professor li. IT, Ilcmmors in collaboration with ten industrial concerns, Fonda for 
this rosoarch were provided by tlie Division of Education and Applied Psychology of 
Purdue University, 
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The need for some instrument for measuring auperviaory quality 
becomes apparent when one considers the uses to which sucli a test could 
be put. A good supervisory ability test could bo used; (1) to select and 
classify candidates for supervisory training; (2) to evaluate the outcomes 
of supervisory training; (3) for upgrading; (4) to check on the quality of 
present supervisory personnel; (5) as a basis for inierviewing and counsel¬ 
ing supervisors; and (6) as material for group discussion at supervisory 
meetings. 

Management was long prone to assume that to obtain the best super¬ 
visor one should promote his best worker. In other words, it assumed 
success on a given job to be a reliable measure of the ability of the 
individual to supervise others who do the same kind of work. That 
such is not the case has been repeatedly proved. Ability to deal with 
personalities, loyalty to management, interest in work and numerous 
other factors make it necessary to consider knowledge of a job and other 
specific factors merely an essential part ratliei- than, all of the require¬ 
ments for good supervision. 

The general factors of supervision are many. Each supervisor, 
regardless of rank and experience, must deal with the attitudes of Ins 
workers, his associates, and hie bosses. Ho must administer company 
policies. He must decide what explanations of wage differentials, vaca¬ 
tion preferences, penalties, and the like must be given. And, most of all, 
he must be sensitive to potential disunity and dissatisfaction among his 
workers in order that the difficulty con be corrected before it reaches a 
point where production will be affected. 

Consttuction of tlie Teat 

In the construction of an instrument for measuring supervisory 
quality, consideration must be given to the relative importance of both 
the general and the specific factors involved. The seemingly predomi¬ 
nant importance of the general factors of supervision is emphasized by 
the large number of books and articles now expressing the need for im¬ 
proved understanding of human relations and the importance of per¬ 
sonalities in achieving industrial harmony. The following statement by 
Dodd and Rice ^ ia illustrative of present personnel trends: “When it 
becomes necessary, new supervisors are selected from the ranks of 
workers, engineers, technicians, and other sources. Experience proves 
conclusively that intelligence, personality, vitality, and leadership should 
outweigh technical or trade ability when the selections are made.” 

Most industrial supervisors are obtained by some form of upgrading. 
It seems quite possible, therefore, that any individual, who is able to 

'■ Dodd, A. E., and Uico, H. 0., eda., How to train workers for war industries, p. 80. 
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qualify for a supervisory position, on the basis of his general abilities, will 
either have acquired, or can acquire, the specific knowledge necessary for 
handling the job. It was on the basis of the hypothesis that factors 
generally common to industrial supervisory ‘posiiims are the really important 
quantilies that this project of constructing a valid measure of supervisory 
quality was conceived. 

When developing any teat, it is necessary to make certain basic 
assumptionfl. The principal assumptions of this study were: 

1. That ability to supervise workers is aomething general in nature 
rather than highly specific to a given job or company. The supervisor’s 
effectiveness is, in the long run, dependent upon hig understanding of 
and ability to deal with human relations. 

2. That lack of this general ability to deal with workers is the greatest 
single cause of supervisory failures and of management-worker friction. 

3. That knowledge of how to handle the supervisory function can be 
tested by obtaining responses to certain significant questions which are 
drawn directly from problems which frequently confront the supervisor. 

4. That such questions can be obtained by direct contact with 
aupervisors on the job, by careful study of the literature concerning 
supervisory fundamentals mid supervisory problems, by taking into 
account the relevant principles of psychology, and by systematically 
"weeding out” those items which prove unfruitful. 

In selecting the items for the supervisory ability test, How Supervise?,^ 
three definite objectives were kept in mind. 

1, The items must be presented in problem form calling for an 
operational response, i.e., the items should ask “What should be done 
. . . ?” or ”Is it desirable to . . . 7", etc. 

2, The items must have "face” as well as statistical validity. They 
must present problems which are pertinent to industrial supervisors 
regardless of the department or the company from which the supervisors 
are selected. 

3, These items must bo simply worded so that any supervisor can see 
the problem involved. 

Item Selection 

Items for How Supervise? were selected from three distinct sources: 
publications concerning industrial .supervision, suggestions from in¬ 
dustrial supervisor.^ and personnel men, and contacts with labor leaders. 
The most fruitful and readily available goui'ce of potential items was the 
industrial literature, Industrial supervisory problems have received 

* Sample copies of tliis test may be obtained from the Psychological Corporation, 
622 Pifbh Avo., New York City. 
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considemblc attention in the last half decade and much has been written 
about the importance of harmonious supervisor-worker relations. Es¬ 
pecially valuable of the published works were the human relations 
manuals and books dealing with specific supervisory problems and their 
solutions.* Contacts with various supervisors in a sizable manufacturing 
concern offered a means of chocking on the practicality of tlie problems 
presented and of obtaining additional items. 

From the sources mentioned above a pool of 204 items was gathered 
for the experimental edition of JJotu Supewsef. Those items were divided 
into two numerically equal forms. Where itejns dealt with closely 
related problems, those items were placed in different forms. All other 
items were divided on an odd-even basis. Many of the items deal with 
problems now under heated discussion. These items were purposely 
included in order to give the test added value as a basis for supervisory 
conferences. 

The personal data which the supervisor was asked to provide were 
purposely made extensive in order to investigate possible relationships 
of tlie.se data with test scores and with management’s ratings. This 
section was purposely placed at the end of the test for three reasons. 

1. The supervisor will be more likely to give his undivided attention 
to oral instructions at the beginning of the teat if not presented with 
preliminary material to be filled out before aiurtvering the teat items. 

2. Any resentment which might occur from a fairly extensive act of 
questions will not affect hia vespoivsca to the items of the test. 

3. Since tests arc usually scored from front to back, the total score 
and the name of the supervisor are brought together with a minimum 
of page turning, This advantage was also evident when responses to the 
items were punched on tabulating machine cards, 

Iton Validity 

The validity of a test item must always be described as validity with 
respect to some standard of value. One of the most vital, and usually 
the most difficult, problems of test construction is that of securing an 
adequate criterion. One criterion for a test of supervisory quality is 
obviously "success on the job-'' Success, however, must be defined in 
terms of some standard and by some individual or group of individuals. 

The problem also arises as to what arc the beat answers to the items 
of a test. To meet the above problem two assumptions were Inade: 

1. "Good" supervisors as a group know the best answers. 

3 Gardiner, Glenn L., Belter Foreinanship, First Edition. New York: McGraw Hill 
Book Co., Inc,, 1936. Heyel, Carl,JKufflan Rdations Manual for Execulivea, New York: 
McGraw Hill Book Co., Inc.. 19.^9. 



Measurement oj Snvemsory Quality in Industry 327 

2. Men who milG books and articles on industrial supervision and 
men actually engaged in directing auperviaory training programs as a 
group know the correct answers. 

Unfortunately, simpiy to assume that the best supervisors know the 
correct answers, though logically aoimd, does not provide an adequate 
criterion, The really crucial problem becomes one of determining who 
these good supervisors are. The writer felt that two groups of people 
should know—(1) the men who work under the supervisor and (2) the 
individuals to whom the supervisor is responsible: in other words, his 
bosses. 

Ratings by members of management above the supervisor proved 
more available than those of the workers. Out of a total of 972 super¬ 
visors tested 5,77 sets of four ratings were obtained. The instrument 
used for rating was The Purdue Rating Scale for Supervisors conatmeted 
by H. H. Remmers and the writer for use on this study. This scale 
asked for an evaluation of the superviaor in terma of seven factors and an 
overall evaluation of hia quality when all factors were considered. 

The orthodox method of test validation consists of having so-called 
"experta” answer the items of the test and using their responses as a key 
for obtaining a total score for all individuals tested. This total score is 
then used aa a criterion for determining the degree of discriminatioh 
possessed by each item. 

Foremost of the problems in obtaining expert judgments is the 
problem of determining who the experts nre. Two groups of individuals 
were sampled to get the expert judgments needed to provide a scoring 
key. Group One of the sample of experts consisted of eight individuals 
who had either written articles or books about industrial problems, or 
were recognized authorities in the field of mental hygiene. To insure 
careful consideration of the test, a check for $10 was enclosed with each 
set of materials sent out. 

Group Two of the experts consisted of thirty-seven individuals work¬ 
ing for the government under the Division of Vocational Training for 
War Production Workers. Twenty-four different states were repre¬ 
sented with no more than five individuals from any state. No financial 
reimbursement was given any member of this group and all responses 
were on a purely voluntary basis. Both groups of experts were asked to 
criticise each Item and offer .suggestions for improvement as well as to 
give the answers they considered beat. 

All scoring of the supervisors’ responses was done from tabulator 
cards. A scoring key was obtained by finding the responses most 
frequently judged best by the two groups of experts combined. Com¬ 
bining the responses of the paid experta with those of the Training 
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■Within Industry group wna justified on the basis of a correlation of 
+ .91 ± .01 between the modal I'csponscs of each group. Items about 
which the experts were unable to agree and those on which the modal 
responses were "uncerfcam" were not used in obtaining the total tost score 
for the supervisors. 

The average supervisor tested for this study was thirty-four years 
old, married, with one or two dependents, nnd probably didn’t own hia 
home, He had a high sdiool education and had iahen a supervisory 
training course. He had worked nearly ten years before becoming a 
supervisor and over six years since becoming one. He was in charge of 
forty-nine workers of both sexes. In the last ten ycar.s he had been 
employed by two different companies. 

Tiivtlier analysis revealed that: only 2% of Ids fellow supervisors wore 
women; 15% of all aupervisora had worked less than two years before 
being promoted and that 38% had been supervisors less than two years; 
only 6% were single while almost 20% liad no dependents; '15% owned 
or were buying their homes; 23% had some college training and two- 
tliirds of the group had completed supervisory training courses; about 
30% bad been with their pre-sent employer for at least ten years or else 
had never worked anywhere else; nnd 73% supervised botli men and 
women while only 27 o supervised women alone. 

These supervisors were drawn from ten industrial concerns. The 
number of siipeiviaors eonlributcd by each concern was a function of the 
8126 nnd organization of tiiat company. 

Tests of the discriminating power of each item of the experimental 
edition of How Supewisef were made with respect to both of the criteria 
previously described, namely, managements’ ratings nnd total scores on 
the test. The method used to determine each item's discriminating 
power was the critical ratio of the difference between the average re¬ 
sponses of the upper 27% and the lower 27% of the siipeivisors with 
respect to the criterion. This method was favored because it involved 
no assumptions as to the right and wrong answers to individual items. 
To the extent that a given item yields significant diffci'encc.s with respect 
to an acceptable criterion, the item can bo conaidcred valid and its 
correct answer will be indicated by the direction of the diffcronco between 
the upper and lower groups. Thus, as was the case with this study, 
when a fallible criterion is used, tlio validity cocfliciont obtained for a 
given item depends only on the item’s value and the general validity of 
all of the experts’ juclgmentg. Weakness of the experts' responses to 
any one item, docs not make it impoasiblo for the item to show a significant 
discrimination ratio. 



Measutemenl of Supervisory Quality in Industry 


329 


When selecting items to be retained for the final forms of How Swper- 
vise? four different factors were considered: 

1. Size of the critical ratios of the differences between the upper and 
lower groups with respect to total score on the test. 

2. Size of the critical ratios with respect to management’s ratings. 

3. Degree of discrimination throughout the continuum of possible 
answers, i.e,, difficulty of the item. 

4. Company to company variation on the item. 

Most important of the above factors used to determine the value of 
the items were the critical ratios of the diffei'ences with respect to total 
score on How Supervisef This criterion was favored because of the high 
agreement between different groups of experts and significant differences 
between the upper and lower groups of supervisors. 

Study of the Criterion 

In this study considerable time and statistical attention was given 
to management’s ratings. It was hoped that a criterion could be ob¬ 
tained whicli would be independent of the items of the test itself. The 
desirability of securing this independent measure of supervisory quality 
is readily apparent when one reviews the advantages which such a 
criterion offers. 

1. Management ratings are made at the actual scene of operation. 
In addition to being independent of the experimental edition of the test, 
such ratings should constitute a measure of actual success on the job. 

2. Since management is solely responsible for determining what 
individuals will be promoted to supeivisory positions, much can be said 
for selecting those individuals who measure up to management’s 
standards. 

3. Management as a group should be more adept at making ratings 
since most modern industrial organizations make use of some form of 
merit rating. 

The 577 supervisors rated for this study were employees of six different 
industrial concerns, ranging in size from 500 workers to 20,000 workers. 
Reliability coefficients and intercorrelationa of the rating scale items were 
computed for the entire population tested. In general, the correlation 
between the traits of the rating scale tended to be greater than the reli¬ 
abilities of the traits correlated. At least 17 of the 28 item intercorrela¬ 
tions significantly exceeded 1.00 when corrected for the unreliability of 
the items. Since no correlation above 1.00 can exist in practice, it must 
be assumed that corrections for attenuation are not applicable to these 

data. The formula, = -==^=, corrects for chance unreliability of 
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the items, but, like all other formulae assuming random sampling, makes 
no allowance for constant or systematic errors. This formula is, there¬ 
fore, not applicable to data in which these conslaiil errors occur. 

Many aiitlioia of statistical texts have asstiined that there can be no 
significant correlation between completely unreliable measures of a jriven 
pail of traits.When corrected correlations iibov(3 1.00 wore found, 
these correlations were as.sumed to be due to sampling error. It was 
assumed that further sampling would reveal either lower item inter- 
correlations, higher item reliabilities, or both. 

Tile writer advances the hypothesis that under conditions where 
excessive halo ® and logical errors exist, these spuriously high infccr- 
correlations beUveen traits can be obtained from Ruceeasivc samples of 
randomly selected ratings. The only rociuirement for such a condition 
is that the logical relation of one trait to another be greater for all raters 
than the reliability of those raters' judgments. 

Four tests of refined methods of scoring the Management Ratings 
were made. In the data tested all attempts at statistical refinement 
failed to reveal significant increases in the reliability of the ratings, The 
methods tested include weighting by Beta weights, z-senres, and item 
reliabilities, 

Of the' 204 items of both forma of the exporimental edition of IIov) 
Supervise? 23 itcjns yielded critical ratios of 2.00 or beltoi- for tlm differ¬ 
ences between tlio upper and lower gi'oups as selected by inanagoment 
ratings, Since less than five items could be expected to occur by chance 
under these conditions, some idea of what management expects of its 
supervisors can possibly be gained by examining the nature of these items. 

Assuming that the item preferences of management-seleclGd super¬ 
visors do reflect management's opinions of what constitutes good super¬ 
vision, the following observations can be made. Management believes: 

1. Its supervisors should accept responsibility for keeping their 
department’s production up and its casts down. 

2. In standardized procedures even to the point of failing to recognize 
the importance of individual differences among workers. 

3. In deeds rather than words. 

4. Its supervisors’ first and foremost responsibility is to management. 

5. rliics arc not the best way to discipline workers. 

6. Workers should not be given regular rest porioda, 

7. Procedures for granting raises and promotions arc management's 
business, not the workers*. 

^Pefcera, Charlca C., and VanVoorhis, Walter P.., Sialislical jiroceditrca and iheir 
inaihemalical basis. 

® Tiffin, Joseph, Industrial psyckolaof/. 
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Probably most significant of the finding on the managemerit-rating 
criterion is the absence of any significant critical ratios on items dealing 
with the mental hygiene aspects of supervisor-worker relations. Most 
of these items were highly significant on the total score criterion. One 
may well wonder to what extent the principles of improved personnel 
relations have trickled through to operational levels. 

To investigate the relation of management’s ratings to personal 
information about the supervisors, the correlations between ratings and 
age, marital and home status, education, working experience, special 
training, number of men supervised, and number of companies worked 
for were computed. Only three of these correlations were significantly 
above zero at or above the 5% level of confidence. There appears to be 
a slight tendency for supervisors, with a great deal of working experience 
before being promoted, to receive somewhat higher ratings, Supervisors 
who have taken supervisory training courses are rated slightly higher, 
More significant, however, is the relation between number of men super¬ 
vised (an indication of rank) and management's ratings. This relation 
is a natural one since it is generally assumed that promotions are most 
frequently given to individuals whom management considered best. 

Validity of Management’s Eatings 

Since the analysis of results on The Purdue Rating Scale f<yr Super¬ 
iors revealed management’s ratings to be of questionable validity, 
tho.se irero as a secondary eritewon for the vaJidaiion of the test 
items rather than as a principal basis for the selection of discriminating 
items, Reasons for skepticism as to the validity of this criterion are 
listed below. 

1. Unusually large halo effect indicating that only one general factor 
was being measured. 

2. Relatively low reliability of total scores on the ratings. Near¬ 
significant increases in reliability were obtained where corrections for 
differences in judges were possible. Since this correction could not be 
made on 80% of the ratings, a known source of sizable errors did affect 
the validity of the criterion. 

3. Variations in quality of raters from department to department 
doubtless existed. Such variations would tend to increase the spread 
of the rating scores and thus increase the computed reliabilities. 

4. Almost complete failure to find significant discrimination values 
on supervisory problems recognized by industrial experts as important; 
items which two groups of experts were able to agree upon. 

Several hypotheses can be advanced for the failure of management’s 
ratings to prove their worth as a criterion. The following seemed most 
tenable to this writer: 
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1. The pyramid of authoxity inh6rent in inchisfcrial organizations 
does not provide the necessary contacts for multiple rating by manage¬ 
ment. Sound organization, according to this hierarchy, requirea that 
each euperviaor ia responsible to only one indivkliiah Hoquiring four 
men to rate a Buperviaor probably necessitates calling in raters who have 
had little contact with the person they rate. 

2. Rating conditions are more difficult to staiulardize than testing 
conditions. Inherent in these' ratings arc auch factors as personal 
relations between rater and aupcrvlsor, personality characteristics of the 
rater, his experience in rating, and company attitude toward merit rating. 

3. Varying standards adopted by raters in a higlily skilled department 
as compared to raters in a non-tcchnical division and company-to- 
company variations can account for extremely wide variations in rating 
scorea which have no basis in terms of supervisory quality. 

4. Quite possibly either or both management rating and liow Suyer- 
emf deal with only part of the required abilities necessary for good 
supervision. For example, operational management has long clisre- 
gerded the area of mental hygiene (or workers and the effects of employee 
attitudes, liow Supervml deals primarily with this area. 

Judgment of Experts 

In addition to being asked to provido the best answers to the experi¬ 
mental edition of How Su'pcrvUcly each of tiio industrial experts was 
asked to mark items wliich he thought wore ambiguous ov of no value and 
to indicate any corrections or comments he cared to make. Each expert 
was also asked if he thought the language used in the items would be 
understood by supervisors and if the approach to the problem was a 
practical one. Over 90% of the experts thought the language was 
sufficiently clear, while between 75% and 80% thought the approach 
to the problem practical. 

Two indications of the reliability of the experts' responses were 
obtained; (1) a correlation of .91 between the modal responses of the 
paid experts and those of the Training Within Industry experts, (2) a 
correlation of .80 was obtained between the experts' scores on Form A 
and their scores on Farni B when scored back on the key derived from 
their modal responses. This would indicate that tho reliability of the 
total score criterion was approximately .89. 

Traditional requiiements for test validity were well satisfied in this 
experimental study of How Swpervisef, Experts in the field in which the 
field in which the teat is designed to operate were able to agree as to the 
correct answers to the items. Tlie reliability of the experimental edition 
was found to be .84 ± .01 for scores on the two forms of the test combined 
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(N ~ 577). Wide vn,riation.9 in the totfl,! georea made by supervisors 
were found ranging from near chance to almost complete agreement with 
the scoring key. 

As would he expected, wide company differences in the average 
quality of supervisors, as measured by total test scores, wem found. 
Of the forty-fivn iliiTcrcnccs between the average test scores made by 
supcrvwors of tlin ten companies tested, 15 were significant at the 10% 
level, IG nt tlic 5% level, and 7 at the 1% level of confidence. This 
would indicate that flomo factor or factors were measured by the tost 
which exist in varying amounts in different companies. This is es¬ 
pecially interesting since significant dilTevences were also found between 
the scores of given groups of supervisors at the beginning and end of 
training periods. The significant improvement measured in the latter 
situations indicated that the test was measuring an. improvement which 
occurred during this period and that there was an overlapping between 
material covered in tiro course and the content of How Supermef. 

Validity of How Supervise? 

Briefly summarized, the experimental indications of the validity of 
How Supervise? arc: 

1. Supervisory achievement in industrial training courses has been 
measured and significant improvements found. 

2. Areas which industrial experts consider vital have been reliably 
measured with test items about which the experts agree. Coefficient of 
Reliability = -\- M ± .01. 

A study wag made of the relation between total score on How Super¬ 
vise? and such personal information as marital status, age, education, 
number of men supervised, etc. Several correlations were found which 
were significantly above zero but not of sufficient size to indicate that 
pergonal data would be of importance in selecting good supervisors. A 
correlation of + .35 between education and total test scores is the only 
relation of sufficient size to be of importance in the Bcloction of BUpervisors. 
The optimum amount of correlation which should e-xist between education 
and a test of supervisory quality is problematical. While such a test 
should not correlate highly with amount of education, doubtless, foimal 
education doe.s provide valuable learning situations which are generally 
helpful. 

It is interesting to note that the greater proportion of this correlation 
resulted from differences between supervisors who had college training 
and those who did not have college traiaing, For example, 44% 
of the elementary school graduates were above the 50th percentile on the 
overall norms, and 60% of the high school graduates were above this 
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point. At the college level, however, 69% of the auperviaora who com¬ 
pleted one year of college and 74% of the college graduate.^ Avere above 
this median score for all supervisors. This would seem to indicate that 
Belection at the college level tends to “weed out" iiulividunls who have 
failed to develop an understanding of the general factors of human 
relations, or that colleges in the student's first year of training provide 
considerable opportunity for gaining insight into human relations 
problems. 

No major changes wero made which seemed likely to cause the 
Bupervieor to place a different interpretation on the problem presented. 
Revisions were made only on items whose relation to the total score 
criterion was significant and which comments by either the experts or the 
supervisors tested indicated some confusion in interpretation. 

Items not included in the final foim were disqualified for the following 
reasons: lack of discriminating power, too easy, or Aveak on one or more 
criteria. 

Each form of the final edition of Hm Suj)emse? contains 70 items 
which are divided into three categories. Care has been taken to make 
each division of a given form equivalent to its oonespondiiig division 
in the other form. Each division is equated on the following factors: 

1. Variability of the item—standard deviation of all supervisors' 
responses. 

2. Discrimination index—critical ratio of the difference betAveeii the 
mean responses of the upper and lower groups. 

3. Difficulty index—deviation of the average response of all super¬ 
visors from the correct response. These values were computed on the 
basis of a three-answer continuum. 

4. Number of positive and negative items in each category of each 
form. 

Quite naturally, industrial participation in this experimental program 
was not of a benevolent nature. To insure that the companies, as well 
as Ave, would receive appreciable benefits, the following reports were sent 
to each cooperating concern. 

1. Scores for each supervisor on the test with percentile values based 
upon norma for all supervisors tested in this study 

2. Individual reports on the quality of each supervisor as rated by 
four members of management. 

3. Summaries of supervisors’ scores on the experimental edition of 
Hoiu Supervised by departments where a sufficient number of supervisors 
were tested to make such breakdowns meaningful. 

4. An overall summary of the company's scores on the test with an 
indication of their relative position with respect to other companies 
tested. 
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5. An item-by-itera ta,bulation of the per cent of the company’g 
BUpervisors who gave each of the possible responses to that test item. 

6, Where forms of the test were given at the beginning and again at 
the end of a training period, comparisons between each supervisor's 
scores were given, together with an overall evaluation of the program 
as a whole. 


Summary and Conclusions 

Conclusions drawn from this study can best be made in terms of the 
hypotheses advanced when plans for the experimental project were 
conceived. These hypotheses logically fall into three categories: (1) 
those which deal with the nature of industrial supervision, (2) those which 
are concerned with criteria against which supervisory quality can be 
measured, and (3) those which deal with methods of scoring and com¬ 
puting data. Both the hypotheses and findings concerning them are 
discussed below. 

The hypotheses advanced as to the nature of industrial aupeivision 
were: 

1. Important aspects of industrial supervisory ability can bo measured 
by test items which are equally applicable to all industrial concerns. True. 
140 discriminating items were found in this studyj items which showed 
no significant variation with respect to the size or nature of the industrial 
concern. Confidence in the importance of these items was expressed by 
both industrial experts and management. 

2. The mental-hygiene aspects of industrial supervision are of primary 
importance. In other words, supervisor-worker relations are among the 
key determinants of good or poor supervision. True. Several indications 
of the validity of this hypothesis were found. 

а. The average discriminating power of the items of How Supervise? 
which dealt with human relations was significantly greater than the 
average discriminating power of factual items. 

б. In response to a felt need, the last decade has witnessed innumer¬ 
able publications of books and articles dealing with the human-relations 
aspects of industrial supervision. 

c, Supervisory training courses, which place considerable emphasis 
on this area, are now being given. 

d. The existence of labor troubles, so frequently blamed on conflicting 
personalities, adds further emphasis to the importance of mental hygiene 
in industrial relations. 

3. A general test of supervisory ability can he used to evaluate the out¬ 
comes of supervisory training programs. True. The experimental edition 
of tv “ • t. wa« 11 " i bv two diffprpTit coTrT“,nip' for t’ i.s purpose. Siir- 
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nificant gains were found in l)otb cases, especially among the poorer 
supervisors. 

4. Age, education, and miscellaneous other variahles are highly im'porlani 
Jaclors in good su'pervision. Generally false. Of all the personal in¬ 
formation examined, only education revealed a relationship above bare 
significance with respect to total scores on the teat. It should be pointed 
out, however, that experience was measured in terms of two-year inter¬ 
vals, Differences which exist betiveen a supervisor of one and a half 
years of experience and one with no experience at all may well have 
been overlooked. 

The hypotheses advanced concerning criteria for validating the test 
were; 

1. Four members o/ management can be found who are sufficiently well 
acquavnied with any pavlicular superuisor lo vale his abilities accurately. 
Questionable. Eatings obtained for this study were not sufficiently 
valid for use as a criterion for determinmg test item discrimination, 
Differences in standards set by different raters, lack of knowledge about 
the supervisor rated, and logical error (halo effect) concerning relations 
between rating traits all tended to make the obtained ratings invalid. 

2. Industrial experts as a group give reliable answers to the problems 
presented in the test items. Ti-uc. Two completely different groups of 
experts agreed closely as to the best anawera to the items of the test 
(r=+.91). 

3. Top management and industrial experts agree on whal constitutes 
good supervision. False. Validity of this hypothesis would have 
eliminated the need for two criteria for the validation of test items. 

The hypotheses advanced concerning different methods of scoring 
botli rating-scale and test data were: 

1. Weighted scoring of ratings significantly increases the reliability of 
the total rating scores. Generally false. The only appreciable increase 
in reliability, which resulted from the previously described weighting 
methods, was that of correcting for the variability of individual judges. 
This increase in reliability was only significant at the 11% level of con¬ 
fidence, and was not applicable to most of the data. 

2. Test Hems which provide Jive possible responses lo each item yield 
more reliable measures of supervisory gualiiy than items which provide only 
three possible responses. False. Identical rcUabilitica were obtained for 
the two types of items. On die basis of this finding, items in the final 
forms of How Supervise? provide for only three possible responses, 
“agree, uncertain, disagree.” 

In addition to the hypotheses accepted or rejected, other observations 
were made for the analysis of the experimental data. Assuming that 
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management-selected supervisors do reflect the attitudes of top manage¬ 
ment in their responses, the folloAving observations can be made: 

1. Management and industrial experts significantly disagree; 

a. On methods of handling dissatisfied workers. Industrial experts 
favor transfer; management opposes. 

b. On methods of handling complaints. Management favors stand¬ 
ardized procedures for each type of coraplaintj the experts favor the 
recognition of individual differences. 

c. As to the desirability of delegating responsibility to workers for 
improving working conditions. Management opposes. 

d. As to the wisdom of allowing regular rest periods. Management 
opposes. 

e. As to whether a worker should be'told what promotions he can 
expect providing he attains a certain level of proficiency. Management 
maintains that these matters of salary and promotion are company 
business which should not be disclosed. 

2. Industrial supervisors, selected by management as best, are not 
fully aware of the importance of human-relations problems in industrial 
supervision. Very few of tlieae problems as presented in the test items 
approached significance with respect to the management-ratinga criterion. 
The same items were highly aigoificant with respect to the total score 
criterion. 

From the hypotheses investigated and observations made, we may 
conclude that general factors of supervision do exist and that these 
quantities can be measured. The human-relations aspects of supervision 
are vital and are, of necessity, receiving an ever-increasing amount of 
attention from management. Industrial experts, both theoretical and 
practical, have rather clear-cut ideas about these general factors. In¬ 
dustrial management tends to be less progressive and seems to favor 
keeping the worker “in his place,” rather than encouraging him to become 
interested in “company affairs.” Management’s idea of what it wants in 
a good supervisor seems rather inclined toward negative rather than 
constructive methods of handling supeiwisor-worker relations. Manage¬ 
ment is, however, well awai'e of the factual problems in industry and how 
they should be handled. Only on items dealing with the mental-hygiene 
aspects of supervision were there indications of significant weaknesses. 

From this study, a test of the general aspects of supervisory quality 
has been developed. It is believed that this test, How Supervised, will 
prove valuable for selecting candidates for and evaluating the outcomes 
of supervisory training programs, for selecting individuals for direct 
promotion to supervisory positions, and for checking on the quality of 
present supervisory personnel. 

LQAA. 



Personnel Placement in the Armed Forces 

John M. Stalnaker 
Stanford Uniwrsily, California 

It ■would be presumptuous lor me to pretend to a comprclieiisive 
knowledge of tlie many and varied methods now being used in the 
selection and placement of personnel in the Armed Services. Many 
groups in both the Army and the Navy have been concerned with these 
problems. The civilian Office of Scientific Eesearch and Dovolopment of 
the Federal government and certain quasi- and non-governmentnl civilian 
agencies have made contributions. It may be permissible at this time, 
however, to review some of the trends and mention some of the recurrent 
problems. 

It must bo recognized that those of us who have been continuously 
working on the problem of selection of service personnel aiiffer at this time 
from lack of perspccti've. We are too clase to the work and therefore 
apt to magnify whnt will ultimately seem like minor operating difficulties, 
The fact that most of the data and testa arc at present "classified^' '■ 
further limits what can be said of them. Virtually all of the tests, as 
Well 0.9 tile research and the invcaligational studies, have been financed 
by the goverament, and all results are therefore subject to .strict govern¬ 
mental control. Government employees and others having access to 
the data are not permitted to report on Buch results without official 
permission, and no such pci'mission has been sought for any matters 
covered in this paper, 

The importance of the wise use of manpower has probably been 
recognized to a greater extent in this war than at any previous time. 
The examples of waste and extravagant use of manpower which can be 
cited may seem to deny this statement. The cost-plus type of contract 
does not encourage economy in the use of civilian manpower, and certain 
branches of the military and naval departments have at times deemed 
it wise to reserve or hoard desirable men. The fact still holds, however, 
that in this war more than ever before attention has been paid to putting 
the mail in the job for which he is b&st suited, and assiguiug to special 
training only such men as could absorb the training in the time alloAvcd. 

* An address delivered at the Cleveland meeting ol the American Statistical Associa¬ 
tion, Soptembor 13,1944. 

^ The term "cltiBsificd," as applied to governmenb docurnenta or data, signifies that 
Ihe material is either "restricUid,” "coiifidcntiaV’ or "secret'*—i.c., available only to a 
small number of specified individuals. 
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Random selection, which was not unknown in the services—for 
example, selecting every other man, or the first ten or twenty men on the 
muster roll—has loecn replaced by methods clearly superior, Some of 
the more satisfactory devices are costly both in time and in dollars—for 
example, assigning any individual at random to try his hand at a complex 
task and retaining him only after he has clearly demonstrated his ability. 
Such methods are being replaced by more efficient and economical means 
of selection which yield demonstrable savings. 

The increase in use of appropriate selection devices is a relative matter. 
There are still to be found able and experienced members of our armed 
forces who believe that, in selecting the fighting man, only the imponder¬ 
able personal characteristics ore of importance and such variables can 
quickly be recognized—^not measured—by only a few men steeped in the 
tradition of the particular branch of service concerned. Even such die- 
hards, however, are gradually coming to recognize that through scientific 
selection—including test scores, an evaluation of background and train¬ 
ing, an estimate of certain personality traits, and a recognition of interests 
—men are now being trained better and faster, And fast technical 
training, no one will deny, has been of the essence. The fighting men of 
today must be technicians who are well trained in the operation and 
maintenance of complex instruments. 

The most striking evidence that the importance of modern methods 
of selection and placement is being recognized ^ found in the number of 
psychologists employed in the task. The work in the office of the 
Adjutant General, in the Air Surgeon's office, in the Medical Research 
group in Naval aviation, In the Bureau of Naval Personnel, in the Armed 
Sei’vices Institute, in the projects under the Committee on Service 
Personnel of the National Research Council and its successor, the 
Applied Psychology Panel of the National Defense Research Committee, 
and in the selection and placement of men in the Army and Navy college 
programs—all these attest the increasing role being played by measure¬ 
ment work in the selection and placement of men. Dollars are so freely 
spent these days that cost figures are less significant, but should someone 
have the time and authority to calculate the cost of the technical and 
developmental work being done by the Army and the Navy in selection 
procedures, the figure would be most impressive. The savings which the 
use of tlie techniques so developed have made possible would be even 
more staggering. It must never be forgotten that no Aveapon is better 
than the man behind it—^and that modem weapons make heavy demands 
on training, and skill, and discretion. 

There are inherent difficulties in finding desirable and economical 
methods for the selection of men destined for success in a war activity. 



340 


John M. Stalmker 


Seldom can all variablea be controlled expenmentally, Lfiboratory 
set-ups arc frequently not feasible. In field checks, a multitude of 
basically irrelevant factors operate to reduce correlation. The require¬ 
ments for a given school nm frequently shifted for reasons not always 
evident to the researeli psychologist. Sudden demands from tlie Meet, 
for exartiple, for more men trained in a particular scliool may force a 
lowering of the standards for the men taken into the school if, as is usually 
true, the supply of manpower ia limited in quality as well as quantity. 
The many difficulties characteristic of field study are augmented by the 
not infrequent and drastic shifts characteristic of the Army and the Navy, 
A radio code school unexpectedly closed down may leave unfiuiahed a 
lengthy and costly experiment. Tlie supply of available men may 
suddenly be changed, rendering a change in standards both desirable 
and necessary. 

There ia seldom a clear-cut and unquestioned final oritorion against 
which to validate selection procedures. The criterion of successful 
performance under combat conditions of the duty for which the man is 
trained is seldom obtainable. Furthermore, combat conditions are not 
stable. The combat situation ia not the same for all men even in a given 
type of work and in the same unit. The best sort of criterion from the 
combat field ia usually a rating or estimate by superior officers; and only 
in rare cases can such ratings, with all thoir weaknesses, be obtained, 
Because this criterion is rarely available and can seldom bo obtained in 
any satisfactory fashion, we must accept intermediate criteria. As a 
matter of fact, so called intermediate or non-combat criteria are entirely 
suitable for many tasks. Weeks and months of preparation are necessary 
for a brief period of actual combat. Many service men must regularly 
engage in duties removed from combat. These prosaic day-to-day jobs 
of the technical sergeant, the yeoman, the atorckijeper, the radioman, and 
many others are of great importance in, making it possible for us to win 
battles. The skill and zeal they show in their non-combat duties should 
not be underestimated. 

Most technical jobs in the services are restricted to men who have 
graduated from formal courses usually called schools. The length of a 
course varies from a few days to several months. To be rated ns a 
torpedoman in the Navy, for example, a new recruit must, after general 
preliminary training, go to a school for torpedomen. To obtain the 
coveted wings of the Naval aviator, one must graduate from the extensive 
aviation training courses. Any economy which can be effected in select¬ 
ing men who will do well in these schools ia obviously worth while. 
Most selection procedures are designed to pick men who have a high 
probability of success in. the school concerned. If scores on a valid 
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perfoi’niftncG tost cjin bo obtauiod for tho criterion, so much the better 
School gi'acles may reflect many traits of the instructor ns well as the 
students, and no are frequently leas useful. If the skill of the bombardier 
is measured by his hits on a target in fifty standardized practice runs, an 
unusually good criterion is available against which to validate the selec¬ 
tion and training procedures. Valid performance criteria are only rarely 
obtainable. 

If the schools in certain cases liave been somewhat out of date, if they 
fail to achieve proper motivation, if they eliminate men for reasons of 
discipline or personality, the problems of selection are complicated. If 
the schools change and improve as rapidly os possible, as they certainly 
should, the nature of the teats and scoi*^ used in selection must be 
subjected to constant study and revision. Selection and training cannot 
be separated; they must be dealt with, in most cases as a unit. 

The first logical step in evolving a progi-am for selection of men to 
enter a certain technical course or school is to make an analysis of the 
school CLU'riculum. This analysis is usually made informally and some¬ 
times intuitively. Tests are then selected which are believed to measure 
the traits deemed essential for success in the school. In selecting the 
men to enter the school, the classification officer should evaluate past 
training and experience along with the test scores. Grades in the school, 
graduation from the school, and ratings obtained are frequently used as 
criteria for the validity of the tests. ■ Many different tests—the verbal 
factor, mathematical aptitude and knowledge, spatial teats, tests of 
general aptitude for electronics, mechanical aptitude, etc.—have been 
given, and various ways of using the results are available. Conditions 
within the schools change, as has been pointed out. Thus there are 
many difficulties in the way of establishing permanent or final methods 
of selection, but the immediate gains made through the use of recom¬ 
mended procedures have again and again been demonstrated. 

Tests and selection procedures which are effective in selecting men 
from one type of population will not necessarily be equally effective in 
picking men from another type of population. If only college graduates 
have been considered for a particular school, a new selection technique 
may be necessary when men with only a high school education are made 
eligible. A selection program suitable for older men with, considerable 
trade experioncG will not necessarily work equally well with men just 
out of school. As the nature of the pool of men from whom selection is 
made changes in its essential characteiistics, the testing program must be 
revalidated. For an accurate and complete interpretation of a test score, 
it is usually necessary to know something about the characteristics of the 
population being tested. 
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An illustration may be taken from the Army-Niivy Collage Qualifying 
Test, An item which is succeaaful ou tlxia test (in the sense of predicting 
total score on the section) for high school seniors from large urban com- 
mimitics in Iowa and Nebraska will not necessarily be equally successful 
for seniors from small rural localiona in Now York state. Coii.sider an 
item in the section on so called comiuon-scuso physics, wliich supposedly 
testa for knowledge frequently obUined from other sources than the 
class room. One item concerned the long distance transmission of 
electric power. This item was approximately of equal dilTiculty for the 
two groups—rural and urban—but much more valid for the group from 
rural New York state. Even in the antonym type of items, significant 
differences are found in certain cases—and these items cannot be guessed 
in advance. Why should domineering ns the opposite of servile be easier 
and more valid for New York city seniom than those from rural Alabama 
and Georgia? The determination of the angle between the hands of a 
clock at 4:10 is more valid for scnioi-s from urban centers in California 
than those from urban centers in New York. 

These populations of high school seniors from different areas of the 
country and from rural and urban environments arc similar in many ways, 
The shifts in the inductee population with changes in draft regulations 
and with the exhaustion of certain types of eligible men are much greater, 
and cannot bo ignored in interpreting test v<^ults. 

There are many techniques now available to improve the eniciency 
of tests and selection procedures. Some method of item analysis has 
been widely used by many of the technicians. Tlirough the use of some 
index such as the biserial correlation coefficient, or some estimate of it, 
or certain empirical indices, an analysis of the behavior of a population 
on the individual item can be determiaed. Non-contributing items can 
thus be eliminated and efficient items retained. The difficulty of the 
item for the population can at the same time be determined. The 
criterion for the analysis usually is the score on the total teat, although 
an acceptable external criterion may be even better if it is available. It 
is to be hoped that the comprehensive study of the interpretation of item 
analysis which has been done for the services will eventually be made 
available for wider distribution. 

In measuring the 8UCocs.s of a test for seleetion, the simple or multiple 
correlation is frequently used, with the test scores on the several measures 
serving as the "independent” variables, and the school grades or success 
on some perfonnance measure or ratings by superiors ns the criterion 
being predicted. In those cases where the tests arc used to eliminate the 
potentially unsatisfactory rather than to predict the degree of success, 
critical or "cutting" scores can be used. In such cases tlie empirical 
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results are shown in a, four-fold table of pass or fail on the test, and success 
or failure in the school. The assumptions underlying the cutting-score 
procedures are more simple and direct than are those where the tests are 
used to predict the entire range from the lowest failure to the top success 
in the criterion; on the other hand, the cutting-score procedures suffer 
from all the statistical and practical disadvantages of coarse grouping. 

Certain personality scales and psychoneurotic inventories have been 
used to select men for special attention by the psychiatrist, or to eliminate 
men from further consideration for certain tasks believed to demand 
stable types of personality, auch as submarine crews or paratroopers or 
men for certain branches of the intelligence service. In these as in many 
other cases, the selection cost ® is an item of importance. Too frequently 
the four-fold table of results presents,percentages only, without including 
the original raw frequencies. The follomng example serves to illustrate 
the importance of this omission. Suppose that, in an experimental 
population of 1,000 cases, a cutting-score is established which predicts 
failure for 60% of the men subsequently rejected, at a cost of only 10% 
of those who arc acceptable in terms of the final criterion. If, however, 
only 60 of the 1,000 men were finally eliminated, while 950 were success¬ 
ful, the teat would have cost 95 (10%) of the acceptable men, in the pro¬ 
cess of detecting 30 (60%) of those who should be eliminated. The 
problem then is to determine how many normals one can afford to 
eliminate, in order to detect a large proportion of the defectives. The 
answer to such a question can o! course he determined only in the light 
of other factors, such as the seriousness of allowing defectives into the 
work, and the availability of men for the work in question. Where the 
unsatisfactory men may ruin expensive, complex, and difficult-to-replace 
equipment, or endanger the lives of other men, a large selection coat may 
be justified. In other situations where the manpower supply is tight, 
the selection cost must be reduced. 

In some of the extensive work which has been undertaken by those 
working on selection procedures with the armed services, certain methods 
are being followed which may subsequently be judged to have been less 
than perfect. A few of the possible sources of error may be suggested. 
The tests being developed in many cases are still covering a more hetero¬ 
geneous field than many feel desirable. Relatively pure tests, i.e. 
homogeneous tests, allow themselves to be subjected to a more rigorous 
interpretation. If wc are to believe general reports, we find that the 
Army general classification test contains several quite different types of 

> As hero used, "selection cost” refers to the number of men faboly rejected by the 
selection procedure. The smaller the number of acceptable men rejected, the lower the 
selection cost. 
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subject matter, verbal, mathematics, and spatial, and yot only a single 
score is obtained, The Army-Navy College Qualifying Test used as the 
first screening for over half a million men applying for the Army and 
Navy college programs contained three separate sections, verbal, mathe¬ 
matical, and science, and yet a single total score served as the basis for 
the screening. Other illustrations could be supplied. There are good 
practical and theoretical reasons for these complex teats being used, and 
for only a single score being repotted; but a good case can also be made for 
the use of separate scores for each of the several components. It is 
interesting to note that revisions are now being developed for more pure 
types of measures in the Army basic battery. 

In a few cases the solection programs use too many Bimilar tests. In 
some cases, fifteen or sixteen teat scores enter into the final selection. 
Possibly a reduced program of five or six relatively pure measures of 
meaningful complexes -would do practically as good a job. Paper and 
pencil tests of the aptitude variety have their limitations, and the use of 
a large number of tests gives no assurance that the traits being measured 
are not fe-w in number. Simpler programs of tests are indicated in some 
cases. 

Another deficiency has been the laclc of careful analysis of the results 
from the total testing program used. Such an analysis would reveal the 
weakness just mentioned. Factor analysis, for example, might be 
brought into play to show how many different factors are being measured 
by the tests employed. Factor analysis techniques, while not extensively 
used in the wartime selection-jobs known to the speaker, have been used 
effectively in several cases. Simple reliability analyses will show the 
undependability of certain of the measures with short time-limits still 
being used. 

A serious error occasionally made is the establishment of selection 
techniques on populations not representative of the population for which 
the techniques are subsequently to be used. In many instances it can be 
demonstrated that the shifts in population are of great importance and 
the results of the tests cannot be interpreted without reference to the 
characteristics of the population being tested. 

The acceptance of defective and unanaiyzed criteria as the basis for 
the validation of tests and selection procedures constitutes a serious 
source of error. Ratings, semce school grades, scores on performance 
trials—in short almost eveiy available criterion measure—should be 
carefully checked and analyzed before it is accepted. How was the 
criterion measure obtained? Of what factors is it composed? Does it 
reflect the abilities and the skills whidi the tests were designed to measure 
or which are essential for success in the job? As testing programs become 
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moie carefully developed, as more homogeneous or pure types of measures 
are used, the final criterion also must be eubjected to analysis and 
purification. In many cases it wOl be found inadequate and will impose 
a limitation on the interpretation of any validity coefficients based on it. 

The poor conditions under which the tests must sometimes be ad¬ 
ministered also account for unsatisfactory results. At times the tests 
are administered to the men when they are in a frame of mind scarcely 
conducive to obtaining a normal sample of their behavior. For example, 
at one location scheduling complications led to the administration of 
aptitude tests to men immediately following inoculations, In another 
case, men were tested in the evening of their fii'st day of very strenuous 
active work on a new location. Quite regularly, unselected men are being 
tested in groups as large os 600 or 1,000—some experts consider that 
better results could be obtained if groups were smaller. As more and 
more trained testing men take charge, improved procedures can be 
expected. 

In spite of all these difficulties and all the weaknesses in the systems 
being used, results of demonstrable value are being produced. Rela¬ 
tively simple selection procedures are being shown to be of value in saving 
time and manpower, in putting the men in the jobs for which they have 
aptitude, and in eliminating the unstable and discontented from certain 
types of crucial work. 

In looking toward the future, the gro^ng intricacies of the machinery 
of war suggest that the country would be safer, if, directly in conjunction 
with the developments and techniques, more time were spent on research 
in methods of selection and training personnel. With new machines and 
improved techniques for the selection and training of men in their use, 
we shall be able to hold our own in any future situation. Psychologists 
and statisticians will do well to establish ever more clearly the gains to be 
obtained by simple but thorough selection procedures and the well- 
systematized use of teat results in the armed forces. 


Received Odoher 2,19U. 



Adapting the Minnesota Rate of Manipulation Test 
to Factory Use 

Guy M. Wilson and Staff 

Personnel fesUng Deparbnent, Raytheon Mannfaduring Company, 

Nenilon, Hassadmetla 

^‘Rate of movement ia a unit skill and in and of itself cannot be 
improved. Only the techniques of performance can be improved,” So 
states the author of the Minnesota Hate of Manipulation Test.^ 

If this ia true, the measurement of an operator's rate of manipulation 
should reveal valuable information. It should provide a significant 
ranking of operators on the one item, speed of manipulation. 

At one plant ® the Minnesota Rate of Manipulation Test waa included 
in a battery of tests in which it was sought to measure operators as to: 
(1) Intelligence—three tests, (2) Manipulative skilWhreo teats, (3) 
Special skill—two or throe tests, according to the job. It appeared to 
hold its place as a helpful test under manipulative skill. 

In time, however, some questions arose with rcferenco to how beet 
to uae the test, and how to record the results. Time is always a factor 
in a production plant, Therefore the question—"Could wo save two 
minutes, more or less, by using three trials instead of four?" The 
Manual for the Minnesota Hate of Manipulation Test calls for four trials 
and the final indent used is the total time for the four trials. If three 
trials would serve aa well, valuable time would bo saved. 

As the above question was studied, another question arose, viz., 
"Would the low score of four trials or three, serve as well as the sum of 
four trials or three, as an index?” If so, time would be saved in adding 
and a simple, more easily interpreted number could be used as the index. 
For example, the gum of four trials for an individual (see Table I, which 
follows) might be 235 seconds. For tlio same individual the bw of four 
is 54 Seconds, The individual who sees this smaller figure, readily inter¬ 
prets it. It means, "One trial rcquiral 54 seconds.” 

The statistician knows that regardless of the convenience or reason¬ 
ableness of a change in proccdui’c, the change cannot be made unless 

‘ Zeigkr, W. A. Manual iar Mimicsola Eato of Manipulation Teat. Educational 
Teat Bureau, Minneapolis. 

* The Raytheon MonufactiR'inB Company, Newton, Massachusetts, 
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afcatistics justify the change. In the case of these two questions the 
procedure for study was very simple. 

Table 1 shows in column I, the ordered ariungement of scores made 
by S3 subjects according to "suras of four.” Column 2 shows the corre¬ 
sponding sums of three trials. Column 3 shows the corresponding lows 
of four trials, and column 4 shows the corresponding lows of three trials. 


Table 1 

Vorioufl Scores for Each of Sixty-threc Factory Workcra on the Minnesota 
Rate of Manipulation Test 


(1) 

(2) 

(3) 

(4) 

(1) 

(2) 

(3) 

(4) 

Sura of 

Sura of 

Low of 

Low of 

Sum of 

Sum of 

Low of 

Low of 

Four 

Three 

Four 

Three 

Four 

Three 

Four 

Three 

Trials 

Trials 

Trials 

Trialfl 

Triab 

Trials 

Trials 

Trials 

177 

124 

40 

40 


174 

66 

50 

184 

137 

40 

40 

220 

174 

65 

56 

192 

141 

44 

44 



54 

55 

196 

148 

48 

48 


175 

66 

57 

190 

140 

49 

40 

231 

172 

56 

56 

200 

181 

47 

47 

232 

178 

54 

65 

203 

150 

40 

49 

235 

176 

64 

54 

200 

162 

48 

48 

236 

182 


58 

200 

158 

40 

40 

235 

173 

54 

64 

209 

155 

60 

50 

236 

178 

58 

50 

210 

168 

61 

61 

239 

1B2 

B7 


211 

169 

62 

63 

1 241 

183 

68 

59 

212 

158 

62 

62 

243 

181 

50 


212 

IGO 

60 

60 

243 

183 


61 

216 

168 

51 

53 

244 

184 

mm 

69 

210 

102 

53 

53 

245 

182 

69 


210 

163 

63 

53 ' 


186 

50 

59 

216 

162 

62 

62 

247 

182 


60 

216 

165 

61 

64 

248 

135 

61 

61 

218 

166 

63 

63 

251 



60 

218 

163 

62 

52 

253 

■ii 

62 

62 

218 

103 

52 

52 

255 

192 


60 

219 

160 

53 

54 

255 

191 

GO 


220 

104 

54 

54 

255 

184 

59 

59 

221 

107 

54 

55 

255 

194 

61 

02 

223 

171 

52 

55 

25G 

194 

61 

61 

22-1 

170 

64 

55 

250 


63 

63 

225 

IGO 

55 

55 

25B 

197 

62 

65 

225 

170 

65 

56 

251 

196 

64 

Q4 

226 

108 

55 

65 

263 


64 

60 

226 

171 

55 

55 


219 

Q1 

67 

228 

109 

56 

SO 
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The present problem is so eimplo that the mere arrangement in order of 
the items, almost answers the qu^tiona raised. There are 15 or 16 
misplacements in column 2, when compared witli cohimti 1, but the mis¬ 
placements arc small. 

■When column 3 is compared with column 1, the story is almost iden¬ 
tical. There are 16 or 17 iniaplacemouta, all very small. In other words, 
the low of four trials would give almost the snino rnnk.s ns the sum of 
four trials. And the some applies to column 4, the hjw of three trials. 

If three trials are as good as four, or approximately bo, and if the low 
of the trials is as good as, or better than the sum, then wc can move on 
to the low of three trials, as the index to use. It will save time, and it 
will be easily understood. 

Comparing columns 3 and columns 4, the low of three trials and the 
low of four trials, it appears that for 43 of the subjects there is a zero 
difference. For instance, the first case, the low of four is 40 and the low 
of three is 40,—in other words, no dilTerence. In 12 of tlio pairs the 
difference ia one. For instance, the first dilTei'cncc is the twelfth case, 
the low of four is 52, the low of tlwee is 53. There arc 12 such pairs as 
indicated above where the diSerenee is one. Thus we have 43 plus 12 
cases in which the difference ia zero or one. The other differencca are 
as follows: 2 cases with a difference of 2; 4 cases with a diiTerenco of 3; 
1 case with a difference of 5; and 1 case with a difference of Q. 

The author of the Minnesota Rate of Manipulation Test does not 
present the data supporting the reasons for tl\e choice of the sum of four 
trials as the proper index. The sum, of course, ia equivalent on a ranking 
basis to the average. An average would give a lower figure, and, there* 
fore, a more easily comprehensible index. On theoretical grounds, and 
in the absence of supporting data, it may be easily argued that a low of 
four trials ia better than an average of four trials. In the field day event, 
such as the pole vault or the high jump, the best score made is taken, 
not the average. 

It is evident, from a casual study, that the correlation between any 
two columns in Table 1 is very high. The correlation between columns 
3 and 4, for instance, using the product moment formula, ia 4- .97. The 
only negative product in the products column is — 3; there are four 
zeros; the other 58 products are positive. 

Correlating ^ the other columns of Table 1, gives the following values 
for r —columns 1 and 2, .985; colimins 1 and 3, + .952; columns 1 and 

4, 4- .968; columns 2 and 3, + .939; columns 2 and 4, 4- .968. 

It was finally concluded in this partioulni’ factory to substitute the 
low of three trials for the sum of four trials as the index of performance 

' Correlations figured by Racbel Lounfilbury, 
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foi‘ the Minnesota Rate of Manipulation Test, It is more convenient; 
it ig more easily understood by some one to whom an explanation of the 
score is being made. It, probably, is an equally good index, although 
the proof of this last statement would require checking by more cases 
than used in this study and correlating with outside criteria, But this 
study ig sufficient to raise the question, and, probably, to justify the 
change to a more convenient and understandable index.^ In a busy 
factory, time and ease of uuderstanding are important factors. 

The above discussion may load the reader to suspect the use of local 
data for the establishment of local norms. This is correct. First inter¬ 
pretations were based upon national or published norma. As soon as 
sufficient cases were at hand to fill in what appeared to be a typical 
distribution, local norms were tentatively established. If conhi’med by 
later distributions, they were then used with reasonable confidence. 
Constant checking of one’s data is necessary in any case and such check¬ 
ing sometimes reveals desirable local adaptations. 

RecBived October 7,19^4- 

* See also Jacob Tuckman: A compariaon of norma for the Minnesota Rato of Manip¬ 
ulation Test. J. Apj)l. Fsych,, 26*. 121-12B, Apr. 1944. 



The Horn Art Aptitude Inventory 

Charles A. Horn sad Leo T. Smith 
Rochsaler Institute of Technology, Rochsslcr, New Yorh 

It is the purpose of this paper to describe the Plorn Art Aptitude 
luventory. This aptitude test has been developed by the faculty of 
the School of Applied Art of the Kochcstor Institute of Technology ^ 
during the past eight years and has been used with freshmen entering the 
Art School at this institution and with groups of high school art students 
competing for Art School Scholarships. 

Construction 

After having studied and experimented with various art tests over a 
period of years, the Art School faculty wore of the opinion that certain 
qualities essential to success in the art field were not being satisfactorily 
measured. The problem of obtaining clues to these qualities in students 
was the objective in designing this test. 

The test is divided into two distinct aections; (1) Drawings of Lines 
and Shapes, subdivided into two ports: (A) Scribble Exercise, and (B) 
Doodle Exercise; and (2) Imagery,* 

In section 1 (Part lA) the Scribble Exercise is designed to give the 
student confidence that he can draw a reasonably simple shape or picture. 
In this part he is asked to draw twenty different items such as a book, a 
fork, etc. and is given a limited time, varying from two to six seconds, 
in which to make each drawing. The total time required for administra¬ 
tion of this section is approximately five minutes. 

The Doodle Exercise (Part IB) ia designed to obtain examples of the 
student's quality of lines, ability to follow directions,' originality and 
compositional sense. In this part he ia asked to draw various lines and 
shapes such as rectangles, triangles, circles, etc, The total time required 
for the administration of this section ia approximately five minutes. 

The Imagery Section (Part 2) ia designed to obtain an indication of 
the scope of the student's interests, and the fertility of his imagination 
with respect to the number of ideas and the ability he exhibits in present¬ 
ing these ideas. In this section there are twelve rectangles 2% inches 

^ Formerly Rochegter Athenaeum and Mechanics lufltitutc, 

* The teat and manual of dltectioim ia diatributed by Educational Reaearcli Office, 
Rochester Institute of Technology. 
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by SH inches in which certain key lines are presented and the student is 
requested to use these lines as "spring boards” and construct sketches 
which are suggested to him by the key lines. Figure 1 shows two 
pictures which have been constructed using the key lines given. The 



Pig, 1. Sample pictures B and C drawn on basis of key lines shown in A. 


total time required for the administration of this section is approximately 
forty minutes. 

Interpretation and Scoring 

In the manual of directions now being prepared for use with this test 
examples of excellent, average, and poor papers are being included. 
This will enable a person not trained in art to have a basis upon which 
tO make judgments. There arc several standards, however, which the 
members of the Art School faculty have identified as important. These 
are: 

1. Order: Are the items so placed on the sheet that they fill it pleasingly 
and indicate that the student has a sense of order, or has the student 
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cramped the items so that the entire page was not used? In other words 
has the wovk been well planned for the size sheet which Ls being used? 

2. Clarity of Thought and Presentation: Are the sketches made with 
a clean line so that there are no erasures or fumbling? Are the items 
recognizable, that is, if the student meant to draw a tree docs the drawing 
reasonably resemble a tree? What is the quality of the line used? Is 
it continuous? Is it broken, cramped, or bumpy or is it graceful and 
smooth? 

3, Color: Is theve a conBiateiitly even tone to the drawings or does 
the sheet appear spotty, i.e. is there evidence of uneven pressures; Are 
the items smudged, fuzzy or erratic in their line quality? 

Inlerprel-ing the Scribble Exercise /-yl: The directions provided with 
the scoi’ing manual are as follows: 

Open up the folder to page 2 and fold the top sheets back. Lay the 
tests side by side on a long table so that you have an over-all view of the 
work of all the papers. 

Scan up and down the papers quicldy keeping in mind the standards 
of order, clarity and color. In this manner tliosc which arc ‘'excellent” 
and those which are "poor” may be readily identified and it will be noted 
that this generally leaves a group wliich may be considered “average.” 
If it is desired to obtain a more precise judgment of rank than “excellent,” 
“average,” and “poor,” by use of the criteria which have already been 
suggested, divide the “average” group into “good,” “average,” and “fair,” 
This then gives five categories: "excellent,” "good,” “average,” “fair,” 
and “pool',” 

It is considerably more difficult to break up the “average” group 
into three sub-groups than it is to judge the extremes. It has been found 
that a lay person, without any training in. art work, can judge the ex¬ 
tremes with as great accuracy as can competent art teachers, but a lay 
person experiences somewhat more difficulty when efforts are made to 
divide the “average” group into the three sub-groups. 

Interpreting the Doodle Exercise 1-B: One important student trait 
often identified here ia originality. For example, has the student done 
the usual thing and divided the square and rectangle in n symmetrical 
manner, which would indicate conformity or triteness, or has he spotted 
the smaller square off center. Similarly, has he broken up the rectangle 
exactly in the center of the sides or has he done the unusual, i.c,, broken 
it up in an asymmetrical manner? 

Interpreting the Imagery Seclion —The criteria which have already 
been mentioned should be kept in mind but in addition the following 
should be noted: 
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1. The fertility of imagination aa indicated by the number of ideas 
presented. 

2. The scope of interests. Are these limited to one particular type 
such as landscapes, people, sea scenes, or does the student have a 
wide range of interests? 

3. The clarity of mental image. 

4. Color—Does the student utilize an outline only or does he shade 
much of his work? 

5. Design—Does the student consistently use abstract forma as 
contrasted with the literal or naturalistic? 

The junior author of this paper (L. P. Smith), who is a member of the 
Educational Research Office and has had no ai*t training, has scored two 
groups of these inventories employing the technique of spreading the 
tests side by side on a long table and identifying those which are “ex¬ 
cellent,” “average” and “poor” on a subjective basis, Then, using the 
criteria which have already been suggested the '^^average” group has been 
divided into “good,” "average,” and "fair.” 

Table 1 

Reliability of Scoring Horn Art Aptitude Inventory 
(Coefficients of correlation between ratings given by two Art School Faculty metobers 
(Ai and Aj) and member of Educational Research Office (E.R.O.)] 



Group 1 * 


Group II** 



Ai Aj 

E.R.O. 

A. 

E.R.O, 

A] 

— .85 

.80 

A. - 

.19 

As 

E.R.O. 


.83 

E.R.O. 



• Group I consisted of 21 Art School students who took this test in the Pall of 1939. 
** Group II consisted of the Scholarship Class of 20 high school seniors who took 
this test during the Spring of 1944. 


Table 1 illustrates the reliability of ratings for these two groups. 
In Group I two Art School faculty members and the junior author 
independently scored 21 test papers of regularly enrolled art school 
freshmen. In Group II one of the Art School faculty and the junior 
author independently scored 20 teat papers of high school seniors com¬ 
peting for fellowships in the School of Applied Art. 

Validity 

Two studies of validity have already been made and others are in 
progress. In the first study all of the students who graduated from the 
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Art School in 1041, '42 anrl ’43 wore nitcd by four Art School faculty 
members on their success in the threi^ yonv wnu'se. I'licr Horn test scores 
of these fituilenlH {N = 52) wc-vc then ctB-rcInted with (lie iweviifro of the 
faculty ratings. The Pearson proilucl-momeiit oorrcliitiou hcLweon the 
Horn test scores of these sludenls and the averuge faciulty rating was 
+ .53, 

In the second study the 3() liigli school scnior.s (uirollcd in the Fellow¬ 
ship Competitimi Classes of 1043 and 1014 were ruleil on their success 
in this class by four Art School facully inendnM's. The Horn test had 
been given to all of these Btiidcnts at the iK’gianing of the class and the 
prQdiict-mQmen.t correlation between their Kciircs niul the average faculty 
rating of success was + .60. 

That tlie Horn Art Invonlory nnuLSures something othci' than iii- 
telligencG is indicated by the ))ro(liict“inoment corrcliition (;f only -f- .15 
between the Inventory test scores for the classes of 11)41, '42, and '43 
{N « 52) and their Awevicau Council on Kduc.alion Psychological 
Examination, scores. That this inventory is of more value in predicting 
success in the three-ycai art course tluui is the A.C.E, intelligence test 
is indicated by tlio product-inomonL correlation of -1- .28 between the 
intelligence test scores and the average faculty ruling of .success for these 
same three classes. 

Summary 

1. The Horn Art Aptitude Inventory has been in the pi'ocess of 
development for a period of more than eight years at the llochcster 
Institute of Technology. 

2. The unique features of this Inventory are; (A) The etudont is 
required to make reasonably simple drawings which illustrate tl\c quality 
of line he employs, his appreciation of proportion, and his compositional 
sense, and (2) the student is given exercises which provide an indication 
of the scope of his interests, the fertility of his imagination, and the 
ability to depict pictorially ideas which occur to him. 

3. The scoring is still somewhat subjective but con'clations between 
the ratings given test papers by Art School faculty incmhcrB and a lay 
person vary from ,79 to .86 for two different groupH of fitudouta, It 
appears that a lay person with no training in art can score tho.se papers 
as adequately as members of the Art School faculty, 

4. The product-moment correlation between the Horn Inventory 
test papers and faculty rating of success of the 52 graduates of the classes 
of 1941, '42 and '43 in a three-year full-time program was .53. The 
correlation between test scores and success in two much shorter Scholar¬ 
ship Classes was + .60 (N = 36). 
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5. The coi’relation between scores on the Horn Inventory and A.C.E. 
intelligence test scores is low (-|- .15). This Inventory is of more value 
in predicting success in the three-year Art School course than is the 
A.C.E. intelligence test as the correlation between the latter and course 
success was + .28. 

Additional studies are being carried on in the effort to make the 
scoring of test papers more objective and to determine the effectiveness of 
this as a predictive instrument for different age groups. It is believed 
that the results of these studies will improve this instrument which has 
already been of value in one institution. 

Received September 18, lO/i/f, 



A New Method for the Administration of Individual 
Intelligence Tests 

Raymond Corsinl 
/libunv Prison, /liifrurn, ATcw Fork 

Most test manuals and books ou tCvSta and mea8\ire.ments agree 
rather well on the general methods of conducting an individual intellh 
gence test (1) (2) (3) (4) (5) (6) (7) (8) (9). Terman and Merrill (7) 
BuramariM in three directives: "(1) Standavd procedures must be followed, 
(2) the child’s best efTorts must be enlisted by the cstnljlishmont and 
maintenance of adequate mpport, (3) responses must be correctly 
scored.” 

However, there is a lack of directions in any manual for the actual 
administration of an individual tost in terms of three variables: (1) where 
to place subject in relation to examiner, (2) where to keep test materials 
during the coume of the examination when not in actual ubGj and (3) how 
much of the behind the scene actions of the exarpiner are to be permitted 
to be seen by the subject. 

The purpose of this article is to give a description and evaluation of 
various ways in which these three variables are met by examiners, plus 
the description of a ne\v method for administering individual tests which 
appears to bo superior to any in present use. 

Placement 

Generally the subject (1) aits at the right hand side of the examiner's 
desk, (2) or faces the examiner behind a table. The second method is 
more comfortable for the subject if he has any writing to do, or if he has 
to handle any material. 

Materials 

Some examiners stow all materials in n desk drawer. Some keep 
materials in small boxes, within a larger box which in turn ie put on the 
desk, Some scatter materials loosely over the desk or table. Some 
examiners keep all material out of sight except when in use. Others 
permit material to accumulate on the desk or on the table. 

The best method appears to be that which is most convenient for the 
examiner and which permits no wasteful searching around for an article. 
Generally, it seems best to handle any items so that they will not distract 
the subject. 

356 
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Scoring 

There are four popular waya to acore the test blank. Two are done 
in the subject’a sight, two are done out of sight. 

Method “A” scores openly on the desk or table. 

Method “B” scores openly but makes a check mark to indicate cor¬ 
rect, and a cheek mark with a loop to indicate wrong. 

These methods have the good point that they help keep up rapport 
in that nothing is hidden. Method "A," however, is poor because sub¬ 
ject tends to change or add to his answer on getting a minus, or may even 
demand why he is being scored incorrectly. 

Method "B” may fool some very dull subjects, but generally subjects 
know when they arc wrong, and realize that some hidden procedure is in 
operation. This method tends to cause unrest on the part of the subject. 

Methods “C” and "D” involve scoring the protocol out of sight. In 
method "C,” the best of these four methods, a visual barrier made 
either from a folder or made of more permanent material is interposed 
on desk or table between subject and psychologist. Behind this barrier, 
tbo psychologist prepares materials, and scores the protocol, The 
advantage is in not letting the subject see what he is being marked, but 
its disadvantage lies in its abruptness and the ‘‘insult” to the subject, 

Method iuvoLves folding the test booklet into quarters, keeping 
it flat on the bottom of a desk drawer, together with stop watch and 
manual, and attempting to mark the protocol in an unobstrusive manner 
with a stub of a pencil. This method, to the author, seems the worst of 
the four, since it soon becomes obvious to the subject that the examiner 
is reading from a book in the desk, and is slyly making notes meanwhile. 

The New Method 

For some time the author of this article has followed a novel procedure 
in administering individual tests that appears to possess supeiior ad¬ 
vantages to any of the combinations of the three general variables so far 
described. 

Following the interview, the subject is asked or is told to take an 
individual test. A table, 18” X 30", is placed parallel to the pull-out 
leaf on the right hand side of the examiner's desk. The subject sits 
behind the table, facing the examiner. From the subject’s point of view 
a box is then placed on the upper right hand corner of the small table. 

This arrangement allows the subject to sit behind the table, with his 
feet under it. He has plenty of space to write. The examiner makes 
his notations on the pull-out leaf of his desk. 
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Aa aoon as both arc settled, the examiner reniovca the test manual 
and a test protocol (blank for scoring renponsca) from the box. This 
immediately indicatea the function of the box to the subject. The 
manna], ia placed on the dask in view of the aubjoet ]>ut too far away for 
him to be able to read from it. The protoeol is placed on the pull-out 
leaf in front of the box, therefore out of sight of the subject. The box 
acta ns a visual barrier, but in so uiituriil a manner that ib cannot disturb 
a subject since lio accepts tire box m an iutegral part of the examination 
procedure. 
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Whenever any test materials are needed^ such as blooks, cards, 
tissue paper, scasoia, form boards, etc., they arc taken from the box, 
quickly and simply, since they are found in various compartments of the 
three shelves or sections, and immediately after use are returned to their 
proper places. Everything is instantly available, nothiuE can accu¬ 
mulate, and since there is no searching for materials the examination 
proceeds swiftly and efficiently. 

The author has had two such boxes constructed, one for the Wechslcr- 
Bellevue and one for the Stanford-Binet. Of course, the arrangements 
of the partitions vary to accommodate different materials. The boxes 
are uniform in size, approximately 5" X 10" X 12". Each box consists 
of three elements or shelves, stacked on top of each other, hinged at the 
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back, and locked to each other at the front by a simple catch. The top 
element has n hinged Gom* 

At the concliitiion of the test, the manual is replaced, and the box is 
put av^ay, ready for the next administration. 


Summary 

1 . There is no uniformity of individual test administration with 
respect to these variables: a. Placement of subject and examiner; h. 
Maintenance of material during the course of the examination; and c. 
Scoring the test blank. 

2. A new method of administering individual tests is described which 
possesses the following advantages: a. Is standard; h, Is fast, efficient, 
and simple; and c. Peduces subjectnxaminer friction. 

Recdeed Sejitcinher 2B, 19U, 
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The Relationship Between Scholastic Achievement and 
Personality Adjustment of Men College Students 

George R. Griffltlis 

Djuisiort Personnel Jl/anojemenl, \J. S. iiarilinic Commission 

Personality is ofton considered an Alladin’a lamp to acliievemeiit, 

If one has "personality,” success is inevitable. If one has no "per- 
Bonality," he may as well resign himself to his fate. Fortunately, such 
an attitude is fast being displaced by n sdentifie appreciation of the true 
nature of that phantom "personality.” 

Broadly speaking, personality consists both of a person’s reactions 
and responses and of the influence that pemon wields over others. Space 
limitations preclude a lengthy discourse on the nature of personality, 
but let us take a moment to view some of its main factors or traits. We 
can do no better than to refer to Allport’s table of personality traits (1). 
Listed concisely, they are: 1. Intelligence; 2. Motility; 3. Toinporament; 
4. Self-expression; and 5. Sociality. 

Some authors add a sixth, ‘physique, Gaakill (3), over a ten-year 
period, made a survey in his beginning psychology classes of the traits 
most desired in a mate. Seventy per cent rwiked health hvat; forty-five 
per cent ranked intelligence second. His list of the elements of per¬ 
sonality is as follows: 1. Intelligence; 2. Social adjustment; 3. General 
characteristics of overt behavior; and 4. Physical characteristics. 

A scientific analysis of personality, its traits, and its relationships, 
should proceed by the examination of specific factors and specific rela¬ 
tionships. The problem here undei'token is to determine whether or 
not there is a significant relationship between personality adjustment 
and academic achievement. 

Previous Investigations 

Those who blandly state that intelligence does not correlate with 
personality are ignoring the fact that intclligonco is an integral part of 
personality. What these persons do mean, however, is that intelligence 
does not correlate highly with varioiia other personality traits. High 
intelligence, according to Sti'ang (9), is ordinarily associated with a 
pleasing personality, since intelligence involves insight, the ability to see 
relationships, and the capacity to learn. 
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A brief suninifl.ry of vfirious otliGr portiiiGiit studies m&y serve to rovefl-l 
the natul'G and findings of previous investigations, A substantial posi¬ 
tive relationship between intelligence os measured by standardized testa 
and personality as judged by interviews and ratings was found in Uni¬ 
versity of Iowa studios (2). However, when scores on personality teats 
and questionnaires arc used rather than tlie results of observation, the 
coefficients of coiTclntion range around zero (between -|- .20 and — .20). 

Terman (10) found that superior children (moat of them with IQ’a 
above 140) are more emotionally stable and more socially adequate than 
unselected children. One study (4) showed a tendency toward small 
negative correlations between scores on neurotic inventories and scholar¬ 
ship. On the other hand Thuratone found, iii applying his Personality 
Schedule to college students, that no relationship existed between in¬ 
telligence and “neurotic tendency,” but that the less well-adjusted 
students tended toward slightly liigher academic grades (6)'. There is a 
tendency for higher learning performance to be associated with sub- 
misslvenesa ns measured by the A-S scale (5). 

Stagner's findings (7) were that unstable and maladjusted students 
do less well in proportion to their intelligence than do stable persona; 
that introverts earn i)roportionatGly higher marks; and that unfavorable 
scores in emotionality and self-sufficiency are associated with lower 
achievement than would have been predicted from intelligence alone, 
Strang (9) reports a lack of relationship between scholarship and various 
measures of introversion-extroverfflon. Finally, reference should be 
made to a study by Stodman (8). She found that the average grades of 
pupils with certain health defects were only 75% those of healthy pupils. 
However, of her 450 cases, the healthy group numbered only 39. 

Occasionally studies appear to show definite relationships between 
personality and scholarship. Others seem to be contradictory. The 
result ia that there has as yet been no clear definition of the connection 
between scholarship and personality. 

Study at Ohio University 

This study was imdoi'taken with Freshman men at Ohio University to 
discover whetlicr there ia a relationship between scholastic achievement 
and, personality adjustment, employing the statistical technique, the 
probable error of the difference between means. The measure of scho¬ 
lastic achievement used was the first semestei* point-hour-ratio; i.e., the 
total number of semester hours of courses carried divided by the number 
of points earned, where A = 3, B = 2, C = 1, and D = 0. The Bell 
Adjustment Inventory was used as a measure of personality adjustment. 
This Inventory measures four types of personality adjustment: health, 
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home, social and emotional, yielding scores for each area and a total, 
composite score, (Strong is firm in her iisscrtian of tlic unvcliabiUty of 
fluch personality questionnaires (9). Her argument is based mainly on 
the fact that they fail definitely to differentiote psychiotrio patients. 
She may be right; that is not the problem here.) 

Ill this study of personality and scliolnatic achievoment several 
different viewpoints wore utilized. The firat approncli was to compare 
with various other groups those men placed on schoinsfcie probation at the 
end of their first acmeater for earning a point-liour-niUo of less than 0.5. 
Tho other groups are; first, a group matched penaon for person with the 
Probation group in college ability Bcores; i.c., scores on tho Ohio State 
University Psychological Examination (Matched group); acconcl, a group 
selected at random (Average group); and third, a group matched indi¬ 
vidually rvith college ability scorea as high ns those of tho Probation 
group were low (Excellent group). 

* Table 1 


CompMiBon of Probation Group with Other Groups in CoUogo Ability, 
Grades, and Pursoiinlity 


Group 

N 

ColleRo 

Ability 

Porcontilo 

Point- 

Iloiir- 

Ilnllo 

Total 

Pcrfionnlity 

Score 

Probation 

40 

21.3 

0.2C0 

30.2 

MaUihcii 

40 



30.4 

Avorago 

40 



37,8 

Excellent 

40 


1.703 

34.8 


Statistical comparisons of these groups in college ability, grades, and 
personality (as meaBUred by the Bell Adjustment Inventory) are presented 
in Table 1, All figures are arithmetic means. A low score is the favor¬ 
able score on the Bell Adjustment Inventory; so the lower the mean, the 
better. Probable errors of the difference between means were computed 
as a measure of the significance of those differences. It is generally 
accepted that to be statistically significant the difference should be at 

Table 2 


Probable Errors of Moan Diffcrtaiccs in Fciaonality of Probation and Other Groups 


Groups 

DifTcrfinco 
ol Means 

P.E. (Diff.) 

Probation and Average 

1.4 

2.367 

Probation and Matched 

2.8 

2,153 

Probation and Excellent 

4.4 

1.904 
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least four times its probable error. The difference in mean personality 
geoves and the probable errors are shown in Table 2. In no instance is 
the difference significant since the probable errors are too great. In the 
comparison of the Probation men with Excellent men the greatest 
difference is found; but it is only 2,2 times its probable error. Appar¬ 
ently, men experiencing scholastic difficulty exhibit no significant per¬ 
sonality differences from persons of superior college ability. 

Another comparison made was’of the Bell Adjustment Inventory 
scores of Probation men and men matched as nearly os possible with 
point-hour-ratioa as high (Opposite group) as those of the Probation 
group were low. Table 3 includes scores of these two groups in college 

Table 3 


Comparison of Probation and Opposite Groups in College Ability, 
Grades, and Personality 


Group 

N 

Collage 

Ability 

Pcrcenbilo 

Point- 

Hour- 

Hatio 

Total 

Personality 

Score 

Frobulion 

40 

21.3 

0.265 

39.2 

Opposito 


85.3 

2.510 

37.4 

ability,.grades, and porsonality. 

The differonoe of 1.8 between the mean 

personality scores is 

clearly not significant. 

as the probable error of this 

difference is 2.000. 

In other words, men 

on scholastic probation are 

approximately equal 

in personality adjustment to men 

with superior 

scholastic records. 







Table 4 



Comparison of Groups Divided on the Basis of Personality Scores 



Total 

College 

Point- 



Personality 

Ability 

Hour- 

Group 

N 

Score 

Percentile 

Ratio 

Very unsat. 

37 

66.9 

42,3 

1.018 

Unsatis. 

122 

48.8 

39,5 

1.004 

Average 

77' 

38.5 

48.0 

1.198 

Good 

112 

17.5 

49,0 

1.169 

Excellent 

17 

7,1 

60.7 

1.263 


A third approach was made by comparing groups of men divided on 
the basis of their total scores on the Bell Adustment Inventory. Five, 
grovips are thus differentiated: very unsatisfactory, unsatisfactory, 
average, good, and excellent. In Table 4 are presented averages in 
personality, college ability, and grades. The difference in point-hour- 
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ratio between the very unsatisfactory- group and the excellent group is 
0.245, in favor of the excellent group. The probable error of this differ¬ 
ence is 0,1187. Since this figure is leas than onc-half the difference, the 
difference between the means of theao two groups is not statistically 
significant. Apparently, men students scoring very unsatisfactory on the 
Bell Adjustment Inventory do not reveal scholnatic trends Bignificantly 
different from those scoring excellent in personality. 

The fourth attack on the problem was a comparison of two groups 
selected on the basis of health scores in tho Bell Adjuatment Inventory. 
This viewpoint was suggested by tho study of Stedman cited above. 
Men scoring very unsatisfactory in health were separated from those 
scoring excellent. Table 5 contains their mean scores in personality. 


Table 5 

Mean Scores of Groups Divided on Iho Basis of Health 


Health 

N 

Total 

Pofaonality 

Score 

College 

Ability 

Pcrccnlilo 

Point- 

Hour- 

IlAtio 

Very unaat. 


■mi 

50,3 

1.133 

Exoelleat 



55.0 

1.441 


college ability, and grades. As an interesting sidelight, the grades of 
those with very unsatisfactory health were 78.6% of thoso in excellent 
health. Although based on smaller samples, this appears to be in line 
with Stedman’s finding of 75%. However, the dificrcnco between the 
mean point-hour-ratios is 0.308, wliich is only 2.3 times its probable 
error, 0,133, and, therefore, not significant. Wo can conclutlD, then, that 
men scoring very unsatisfactory in health are not porticularly inferior in 
aoholaafcia achievement to, although a difference appears to exist in favor 
of, those in excellent health. 

A fifth comparison made was of the grades of men scoring very un¬ 
satisfactory and men scoring excellent in emotional adjustment on the 
Bell Adjustment Inventory. Table 6 contains mean personality scores, 

Table 6 


Mean Scores of Groni® Divided on tho Bneia of Emotional Adjustment 


Emotional 

Adjustment- 

N 

Total 

PcFBoncdity 

Score 

Colbgo 

Ability 

Percentile 

Point- 

Hour- 

Rafcip 

Very unsat. 

■■ 

68.0 

42.58 

1.144 

Excellent 

■i 

14.0 

56.66 

l.llB 
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college ability pGrccntilcs, and point-hour-ratios of these two groups. 
The difference in point-liour-mtios is 0.026 in favor of the very unsatis¬ 
factory group. This is the only difference in the study which appeared 
contrary to expectation. It corresponda, however, with the tendency 
Thurstone found in atudioa mentioned above. As its probable error 
amounts to 0.1001, no importance can be placed on the difference. The 
difference is also the smallest revealed in the study as it is but one-fourth 
its probable error. 

A final analysis utilized comparison of the highest and lowest deciles 
in college ability to see whether differences in pei*fionality might exist. 
This is more nearly a comparison of personality with intelligence. Mean 
scores for these two groups are contained in Table 7. In this case the 


Table 7 

Mem Scorea of Groups Divided on tho Basis of College Ability Scores 




Point* 

Totul 


Group 


Hour* 

Personslity 


N 

lUtio 

Score 


Lowest 10th 

30 

0,533 

42,7 


Highest lOtb 

38 

2.092 

37,7 



difference in personality scores is 5.0 in favor of those in the highest decile. 
This difference is 2.1 times its probable error and, hence, not great enough 
to be accepted as of statistical significance. The only conclusion that 
can be drawn is that men in the highest and lowest deciles of college 
ability do not show a marked difference in personality. 

Results and Conclusions 

The question of whether there are vaJid refationships existing between 
Bcholaatic achievement (point-hour-ratio) and personality (Bell Ad¬ 
justment Inventory) has been examined here from several different points- 
of-view. The results are these, briefly: 

1. Men clearly in scholastic difficulty, having been placed on academic 
probation, are not very much inferior in personality adjustment scores 
to men of superior college ability (Tables 1 and 2). 

2. Men students with brilfiant scholastic records are no better 
adjusted in personality than men of lowest academic achievement 
(Table 3). 

3. An analysis of men with very unsatisfactory personality scores 
shows no significant difference in their grades from those with excellent 
personality adjustment scores (Table 4). 




366 


George R. Griffiths 


4. Scrutinizing a comparison of men wth very unsatisfactory health 
scores with men of excellent healtli scores reveals a small but not signifi- 
cant difference in favor of the excellent group (Tabic 5). 

5. Men with very unsatisfactory emotional ndjustment scores tend 
toward higher grades than men of excellent emotional adjustment scores, 
but the difference is not significant (Tabic 6). 

D. There is no very great difference in personality scores evident 
between men in the lowest decile of college ability (The Ohio State Uni¬ 
versity Psychological Examination) and men in the highest decile 
(Table 7). 

In every case but one there is such a differencD as suggests some 
degree of positive correlation between scholastic achievement and per¬ 
sonality. But as a difference, to be accepted as statistically significant, 
must be at least four times its probable error, the differences found are 
not large enough to be valid. In these analyses the differences ranged 
from 0.25 to 2.3 times their probable errors. Nevertheless, it seems 
reasonable to coni^ude that the oousistoncy of these differences, even 
though they are small, is in itself important. It may mean that our 
psychometric techniques, especially personality measures, are in need 
of refinement. Then, too, it may mean that actual differences do not 
exist, however logical it is to expect them. In any event, no conclusions 
can be safely drawn until further research is conducted with more positive 
results. 


Suggestions for Further Study 

Further study along two lines might be productive of useful results: 

1. The difference in mean personality scores between the Probation 
and the Matched groups in favor of the lotter (Table 1) hints that per¬ 
sonality factors may be present to infiuence the difference in grades of 
persons of equal college aptitude. The causes of diverging academic 
records of persona of approximately equal mental ability should be 
investigated to determine whether personality factors are present. 

2. Since college students are highly selected, nearly all being above 
normal in intelligence, studies should bo made whore gi'oups definitely 
below average can be compared with those high in intelligence. 

Received iffepiemter SO, 19^. 
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Negro-White Attitudes Towards the Admmistration of 
Justice as Affecting Negroes 

F. C. Sumner and Dorothy L. Shaed 
Iloivard Universily 

li was proposed in this study to measure tlic degree of unanimity in 
attitudes of Negroes and wliites both at the college level and at tlie adult 
level with icapcct to the administration of justice as affecting Negroes, 

Motliod 

A questionnaire was devised consisting of 5G statemonta taken from 
the spontaneous conversations of Negroes. The respondents were 
inatructed to read each atatemeut aud to indicate their reaetioii with a 
circle in one of the following six ways: 

If you feel that the atatomonl is absolutely true, draw a cirelo around 
the symbol T^, 

If you fed that the statement is more true than false, draw a circle 
around the symbol TsFj. 

If you feel that the atatcraenl is about equally true and false, draw a 
circle around the symbol T 2 FJ. 

If you feel that the statement is more false tlian true, draw ii circle 
around the symbol TiF^. 

If you feel that the statement is absolutely false, draw a circle around 

F*. 

In case you do not understand a statement, draw a circle around the 
question mark. 

Personal information was requested such as sex, ago, race and whether 
or not one had had any court experience (By court experience was meant 
any expei'lence from being merely a “spcGtator'’ to being a judge). It 
actually turned out that the attitudes of those with court experience 
differed very slightly from the attitudes of those without court experience. 

Of the 1,009 persons replying to the questionnaire'there were 246 
white college students of whom 176 were male and 70 female; 600 Negro 
college students of whom 261 were male and 399 female; 193 adults of 
whom 42 were white and 151 Negro. 
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The 906 college students repKed from the following colleges: 


University of Illinoia 

60 

(M 

44, F 22) 

University of North Carolina 

90 

(M 

81, F 9) 

University of South Carolina 

64 

(M 

31, F 23) 

Uiiivorsity of Florida 

86 

(M 

20, P 16) 

West Virginia State College 

60* 

(M 

3B, F 64) 

Howard University 

48* 

(M 

23, F 22) 

University of Illinois 

13* 

(M 

0, P 13) 

Tennessee State College 

97* 

(M 

26, F 71) 

Florida A, and M. College 

94* 

(M 

49, F 46) 

Alcorn A. and M. CoIIcgo (Miss,) 

77* 

(M 

53, P 24) 

State College, Orangeburg, S. C. 

105* 

(M 

27, F 78) 

Virginia State College 

137* 

(M 

45, F 92) 

Negro college students starred. 





The 193 adults who replied lived in the District of Columbia. 

In reducing the great mass of raw data to manageable terms the 
following formula was devised and designated the True-False Index 
(TF Index) of a group in respect to a particular statement: 

{Ti + TaF, -)- + T,F, + FQ 

N (= total number of replies to the specific statement) 

For example, the 174 white college males replying to Statement No. 
27 (Judges are entirely free of racial prejudice) distributed as follows: 

Ti TsF, T^Fi TiFi Ft 

9 35 24 55 51 

and the TF Index is 


or 32% - G8% = - 36%. 

This obtained TF Index means that 36 per cent voted against the pro¬ 
position over and above the remaining 64 per cent who were tied between 
accepting and rejecting it. 

TF Indices vary between -b 100 (unanimous belief of the group in the 
truth of a statement) and - 100 (unanimous disbelief of the group in the 
truth of a statement). When TF Indices arc + 100 to -b 34 inclusive, 
they indicate a definitely positive reaction on the part of the group in oa 
much as two-thirds or more of the group accept the proposition; when 
TP Indices are + 33 to — 33 inclusive, they indicate a definitely mixed 
reaction on the part of the gi’oup in as much as two-thirds or more of the 
group are tied between occepting and rejecting the proposition; when 




174 


174 
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TF Indices are — 34 to — 100 inchiaivc, they indicate a definitely 
negative reaction on tlio part of the group in aa inucli ns two-thirds or 
more of the group rcicct the proposition. 

E&sulta 

Percentages of the 50 statements to wliieli po.sitivc, mixed and nega¬ 
tive reactions arc made by each of the several groups arc given in Table 1. 


I’abic 1 

Percentagea ol tho 56 SlateiTienla to wl^ich Positive, Mixed and Negative PcactionB 
arc Made by Each of the Several Groups 


Group 

Positive 

Mixed 

Negative 

All White Adults 

7% 

71% 

21% 

All White College Studenta 

34 

41 

25 

Wliite College Males 

32 

43 

25 

White College Femalc .1 

30 

30 

SO 

All Negro Adults 

45 

27 

26 

All Negro College Students 

46 

34 

20 

Negro College Males 

41 

34 

25 

Negro CoUogo Females 

48 

32 

20 


From Table 1 it appears that in the wlutc adult group the percentage 
of mixed reactions is higlicr than either that of j)osi(,ive or that of negative 
rcflctiona and even higlier than the combined percentages of positive and 
negative reactions. In tlie white college gro\ips tho percentago of mixed 
reactions is higher than either that of po.sitivc or tliat of negative reactions 
but not higher than the combined percentages of positive and negative 
reactions. On the other hand, it appears that in all Negro groups per¬ 
centages of positive reactions arc higher than eifelier that of mixed or that 
of negative reactions while combined percentages of positive and negative 
reactions are in every case higher than the percentages of mixed reactions. 

The very strong tendency of the white adult group towards mixed 
reactions (two-thirds or more of the group being tied between, accepting 
and rejecting the statements) may be thought due at least in part to the 
fact that the issuing of the qiicstionnairea to this group was done in 
person by a Negro wliich may have in a selective or moderating way 
influenced the reactions. On the otlior hand, the mixed reactions of this 
adult white group appear to be but a fuller manifestation of a tendency 
to reservation, i.e., to mixed reaction already perceptible in every white 
group of college students despite white admiaislration of the question¬ 
naires. Factors more likely influencing white groups to mixed reactions 
tnay be gleaned to some extent from scattered comments written in the 
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Table 2 

TF Indicca of tlic Several White and Negro Groups for Each of the 66 Stntemeata 



Adults 

College 

Students 

Male 

Collogo 

Students 

Female 

College 

Students 

Wliito 

42 

240 

170 

70 

Negro 

151 

660 

201 

390 

Total 

193 

900 

437 

460 

1. The practice of Negro lawyers should be conBned to routine office work. 

White 

-65 

-51 

-53 

-47 

Negro 

-97 

-04 

-69 

-70 


2, In the cyea of the court one white witnesa ia better than any number of Negro 
witnesses, 


W 

-12 

-17 

-21 

- 6 

N 

9 

31 

16 

41 


3. Negro lawyers am as well prepared for the practice of law as are wliito lawyers. 


W 

45 

-10 

-18 

7 

N 

55 

4B 

36 

51 


4. Where the litigation is between a Negro and a whitc^ the white man or woman 


is favored to win in court without regard to tlie merits of the case. 


W 

-24 

37 

38 

34 

N 

34 

39 

20 

48 


6. Negro lawyers do not prepare their cases os well as white lawyers. 


W 

N 

-16 

-53 

-41 

-65 

-38 

-48 

-48 

-59 

0, Negro jurors nro more easily swayed than white jurors. 


W 

15 

25 

31 

9 

N 

-29 

-17 

-20 

-15 


7- Negroes give too much irrelevant material in their answers to questions in court, 


W 

24 

30 

31 

23 

N 

1 

24 

23 

24 


S. Negroes should be represented on the staff of ponal inslitulions in which the 


prison population contains Negroes, 


W 

N 

21 

89 

49 

77 

4G 

81 

50 

75 

9. More severe sentences are meted out to Negroes than to whites for the same 

offense. 





W 

- 8 

46 

40 

34 

N 

64 

64 

51 

22 


10. A Negro represented by a white lawyer receives a lighter sentence than a Negro 
represented by n Negro lawyer. 


W -43 

N 26 


24 

2fl 


2S 

31 


13 

24 
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Table 2—Coati’nued 


Male Female 

Colkgo College CoUego 

Adulla Studenta Sludciits Students 

11. A light complexionccl Negro teciflves a more severe judgment by a whits Jury 
than a dark comploxioncd Negro. 

W -68 -47 -38 -08 

N -44 -64 -03 -64 

12. A Negro on a jury in tho South ia afraid to vote contrary to consenaus of opinion 
of the white jurors, 

W -21 55 65 63 

K 62 35 28 39 

13. A Negro litigant who is employed in a menial capacity by indacutinl whites ia 
favored to win in co\irt over a Negro not so employed. 

W -25 61 64 61 

N 69 67 73 03 

14. Judges havQ their minds modo up boforo ht^ring a case when tho litigation is 
between a Negro nad a whito. 

W -70 -04 -64 -72 

N -21 - 3 - 0 - 1 

1C. Negro lawyers feel that Negro jurors aro projudiced in favor of tho white aide 
of the COSO. 

W -41 -66 -62 -73 

N -24 -31 -34 • -29 

to. A Negro policoman arresting o. white man cannot bring sufTiciont evidence agaioat 
him to secure bis conviction. 

W -60 -68 - 62 - 41 

N -40 -60 -02 -61 

17, Many eases of Negro cooviclion arc found to be miscarriages of justici} years 
afterwards. 

W -11 17 20 - 0 

N 48 00 68 01 

18. Of several persons found Ongmatly breaking the law, it is usually the Negro iu 
the group who is arrested. 

W 0 40 33 63 

N 66 64 45 01 

19. Other things being equal, o. whito lawyer ie favored to win in court over a Negro 
lawyer. 

W 7 71 76 60 

N 64 43 36 48 

20, A whito woman's word in accusing a Negro is "proof poaitive" in court. 

W 10 20 23 13 

N 46 66 61 67 
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Table 2—Continued 


Mala Female 

College College College 

AduUfl Students Students Students 


21. Without provocation Negroes are beaten and otherwise maltreated by white 
policemen. 


w 

N 

6 

6Q 

-26 

63 

- 9 

52 

-64 

64 

22. White policemen who, without provocation, boot up Negroes arc never convicted 

of their oltcneo. 





W 

- 3 

-30 

-10 

-59 

N 

00 

30 

24 

34 

23. Negro lawyers will keep you in court the rest ol your Bfe. 


W 

-25 

-82 

-82 

-83 

N 

-76 

-76 

-78 

-71 

24. White iurios arc more prejudiced against the Negro on trial than white judges. 

W 

-21 

47 

50 

30 

N 

28 

24 

20 

20 

25. Wliite lawyers make ligkt of Negro lawyers in court. 


W 

-29 

20 

31 

14 

N 

- 1 

9 

20 

2 

26. White polioemon do not cooperate with Negro policemen on the force. 

W 

-32 

-32 

-31 

-32 

N 

-61 

-27 

-24 

-20 

27. Judges arc entirely free of racial prejudice. 



W 

-20 

-34 

-36 

-31 

N 

-72 

-51 

-61 

-47 

28. Negro lawyers lack the integrity of white lawyers. 


W 

-40 

-29 

-24 

-42 

N 

-93 

-59 

-59 

-50 

29, In the attitude of the court the Negro fans no rights which the wliitemauis bound 

to respect. 





W 

-12 

-73 

-78 

-71 

N 

-38 

-20 

-60 

-22 

30. Even federal courts countenance refusal of certain privileges of the court build- 

ing to Negro lawyers. 




W 

14 

-13 

-17 

0 

N 

58 

21 

14 

27 

31. More white offenders are let off on insanity picas than Negroes when both are 

accvised of tlie same olTcnso. 




W 

38 

60 

72 

48 

N 

60 

72 

72 

71 

32. White lawyers havo more outade influence with die court tlian do Negro lawyers. 

W 

40 

89 

91 

83 

N 

65 

82 

88 

78 
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Ta-ble 2—Continued 


CoUcgG 

Studcota 


Male 

Collego 

Students 


Female 

College 

Studonta 


33. In the South a white person must bo quite n social outcast to bo convicted of a 
crime against a Negro. 

W 2G 38 40 35 

N 75 60 66 73 


34. The court bcliovea a white lawyer is entitled to a larger fee than a Negro lawyer 
for the same piece of work. 

W 18 8 8 7 

N 40 63 63 69 


36. If a Negro is numbered among a group of suspects, ho is usually the hrsb to be 
grilled. 

W 41 60 82 64 

N 78 71 08 73 


30. Negro lawyers have few opportunities to practice other than routine office work. 

10 43 30 63 

N 6 43 31 61 


37. Negroes do not deserve tire ptiTileea of a court trial like other people. 

W - 67 - 08 - 08 -100 

N -100 -100 -100 -100 


38, Negro lawyers do not take extra courses in law after receiving their law degree 
because they have little opportunity to use their knowledge. 

W 3 -28 ’ -33 -17 

N -16 -22 -19 -24 


39. Negro offenders under legal age are more orten put into institutions with hard¬ 
ened criminala than white offenders of the sarac age. 

W 0 30 42 23 

N 06 57 68 67 


40. Many Negroes never bring suit against white persons, regardless of the amount 
of proof, because they feel that they ore bound to lose in court. 

W 10 61 61 61 

N 62 64 62 66 


41. In coses of erroneous coDvicticn of Negroes nothing is ever done to the person 
or persons who originally brought the false accusatioin 

W 0 10 12 2 

N 69 45 37 60 


42. In cTiTTiinal inetitutions Negro offenders arc segregated into, poorer quarters, 
given the moat laborioiis tasks, and ore in other ways maltreated. 

W -10 14 15 

N 74 50 45 


14 

64 
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Table 2—Continued 


Adults 


College 

Students 


Male 

College 

Students 


Female 

College 

Students 


43. In tho South the Bcntencing of a Negro vap'ant to a chain gang is usually a life- 
sentence. 

W “ 3 —66 -68 -67 

N 12 13 -10 28 


44. Negroes receive aa much juatico in courts aa do whites of similar social status. 
W -16 -11 -10 -13 

N -39 —37 “36 -38 


46, A Negro lawyer in the North receives fairer recognition in court than a Negro 
lawyer in the South. 

W - 6 77 78 76 

N 78 85 88 83 


46. Negroes would not know that they were treated unjustly if it were not for agi- 
tative organizations. 

W -22 -33 -36 -27 

N -47 -49 - 49 -43 


47. White policemen accept bribes from Negroes only to bavo them arrested for 
bribery. 

W -39 -67 - 06 -70 

N -42 1 -19 16 


48. White policemen accept bribes from whites and do not have thorn arrested, 
W -41 27 36 3 

N 26 40 30 40 


49. Negro lawyers are shy about going up against white lawyers, 

W -24 24 23 28 

N -64 -12 -26 - 2 

50, Negroes in reality convict themselves in court due to ignorance of legal pro¬ 
cedure. 

W 20 7 9 2 

N 14 3 3 36_31 


61,. In democratic countries where everytlung depends on majority-vote courts are 
necessarily unfair to members of minority grouj^. 

W -69 -23 -28 -10 

N -40 27 29_ 25 


62. All cases of whites vs. Nogroea or vice versa should be tried in Federal courts. 
W - 8 -33 -31 -39 

N -13 38 42_30 


53, A shabbily dressed,, "hat-in-hand" Negro lawyer has more influence with the 
court than a well groomed, intelligent Negro lawyer. 

Yf -64 -47 -42 -59 

N -40 -49 -40 -53 
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Table 2—Continued 


AduUa 

College 

Students 

Male 

College 

SUidcnU 

Fomalo 

College 

Students 

54. The victories Negroes win in court nre Icft-hniidod victories. 


W -24 

-34 

-32 

-44 

N -22 

-10 

-10 

-16 

55. Negroes are not aa financiaWy able na whiles to purchase justice in courts. 

W 33 

66 

68 

66 

N 73 

76 

77 

75 


56. It will take many more ycara before llie Negro can have his constitutional ri^ita 
granted him by courts, 

W 28 41 43 38 

N 5Q 65 63 66 


margins of quostionnairca by white aiudente as for examples; A Tvhite 
female student of the University of Soutli Carolina with no court experi- 
eneo writes: "Some of these iiijiiskices against Negroes may be and 
probably are true, but they shouldn't be." A wlnto male student from 
the same university writes: "Impossible to have an intelligent opinion 
on some of these questions. Negro lawyers aren't exactly numeroua in 
the South." A white male student at the University of North Carolina 
and with court experience writes: "Sectional factors and differences 
between Northein and Southern courts are of such a nature that I cannot 
answer adequately. Northern and Southern courts are as different ns 
night and day." A male white student of the University of Illinois says: 
"It is difficult to answer some of the questions unbinsedly because when 
they refer to the Soutli they may be true, and false when they refer to 
the North," A male white student from the same university: "Negroeg 
deserve as much justice as whites, but it is undoubtedly true that they 
receive less. It will take many years, if ever, for these social prejudices 
to be lived down," A white female student at the University of Florida 
writes: "I have no knowledge of the existence of a ‘real’ Negro lawyer." 

A realization of the complexity of the situation, an appreciation of 
move than one side to the matter, a conBiet between ideals and practice, 
lack of familiarity with the problem, little or no emotional involvement 
in. the matter appear to be some of the factovs making for mixed reactions 
so conspicuous in, the whites. 

In Table 2 are pre.sented the 66 statements and the TF Indice.s of the 
various Negro and white groups for each statement. From Table 2 it is 
possible to make a direct comparison of any two groups in their reaction 
to a specific statement. 
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In Table 3 are presented the Pearson correlation coefficients of the 
66 TF Indices for the various pairs of groups. 

Tables 

Pearson Correlation Cocffioienta of the 66 TP Indices for the Varioue Pairs of 
Groups Arranged in Deaconding Order 


Negro College Males and Negro CoUego Pemalea .95 

Whito Collego Males and White College Pemalea .64 

All Negro College Students and AH Negro Adults .93 

Negro College Males and "White College Males .87 

Negro College Males and "White College Pemalea ,79 

All Negro College Students and All Whito Collego Students .78 
Negro Collego Females and White College Males .77 

Negro College Females and White College Females .76 

All White College Students and All Negro Adulta .70 

All Negro College Students and All "Whits Adults .72 

All Whito College Students and All White Adults .62 

All Negro Adults and All Whito Adults .60 


Conclusiona 

The moat aignificant conclusions which may be drawn from the results 
of this study appear to be as follows: 

1. While Negro and white attitudes towards the 56 statements relative 
to the administration of justice aa affecting Negroes correlate to a signifi¬ 
cant degree, this resemblance is much higher between Negro and white 
college atudents (.78) than it is between Negro and white adulta (.60). 

2. The correlation between attitudes is conapicuoualy higher between 
Negro college students and the Negro adults (.93) than between white 
college students and the white adults (.62). 

3. While the resemblance in attitudes between the white college 
students and the Negro college students is high (.78), conapicuoualy 
higher ia the resemblance between white college males and white college 
females (.94) and between Negro college males and Negro college females 
(.95). 

4. The attitudes of the Negro college females and of the white college 
females (.76) correlate less than do the attitudes of any other two inter¬ 
racial groups among college students. 

R$ceived August 17,1944’ 




Values Students Reported from the Study of Emotions 

Key L. Barkley 

Woman's Colkgt of The University of Norlh Carolina 

Both the fi'iends and enemies of psychology have criticised it as an 
undergraduate course in the university on the grounds that it contributes 
very little of real value to the student. The opinion hag been offered 
that perhaps the "worat defect in the elementary course is that it is evasive 
in application, and that this weakness prevents the student from securing 
material ■which actually functiona in hia life. That is, the student may 
get a wealth of psychological fact, but receive little of psychological value. 

Purpose 

The purpose of the project reported here was not to discover simply 
what or how much the students kneio about the facts, laws, and principles 
which characterize and govern human behavior, but to find out what 
values in any way or of any kind they believed they had secured through 
the study of a topic in psychology. The word “value" was interpreted 
to the students to mean any benefit, help, or gain they had received from 
the study, or any detriment, hurt, or loss they had suffered. In order 
to make the findings as definite as possible, to give the students a restricted 
topic on which to formulate judgments, and to increase the probable 
accuracy and dependability of the findings, the study waa limited to the 
topic of “emotions." 

Subjects 

Two hundred twenty-six students of elementary psychology, who 
recently had completed their study of the topic of emotions, contributed 
their statements of values received. All of these subjects had the same 
readings assigned from two basic texts, and all of them had about the 
same number of lecture-discussion periods, namely six. 

Procedure 

Since there was no instrument available for the students to use in 
stating their judgments of values received from the study of emotions, 
the investigator had to deviee one. To that end, forty-eight students 
were asked to write essays of about 200 words on the topic “The Values 
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I Have Received from the Study of Emotions.” The experimenter read 
the essays and made a list of all the values the students said they had 
received. From the collection of statements, which were kept in the 
students’ OAvn words as far as possible, a check-list was made with the 
various stated values classified under nine arbitrary headings. The 
changes in statements when made were simply to shorten or to generalize 
the item. 

The completed check-list was given to the students with the directions 
to check nil the items which were statements of values they had received 
from the study of emotions, and to write in statements of values received 
which were not given in the list. It was made plain to all the students 
that their work with the check-list would have no relationship to their 
standing in the course in psychology which they were studying at the 
time. 


Results 

The number of people who checked the various items on the check¬ 
list was tabulated, and the per cent of the total of 226 subjects who 
checked each item was calculated. These percentages are shown in 
the first column of Table 1, which also presents the items in the check-list 
used in the experiment. 

Certain findings are reasonably clear from an analysis of the data. 
The most obvious one is that over 80% of the students say they received 
definite and known benefits from the study of emotions. Only 17.3% 
of the students said that the study of emotions had had very little effect 
on them as persons (see item number 73). Moreover, some of those who 
made this statement went on to explain that they had received some 
advantage from the study, because it would help them in their professions 
such as social work. 

A second clear finding is that a large number of people said they had 
received the values given in the check-list. The average number of 
persons out of the 226 who checked each item indicating a favorable 
value received was 128, or 56.6% of the group. It is obvious also that 
each person must have checked a considerable number of items, The 
average number of items checked by each person out of the total of sixty- 
four possible ones was 35.8. This means that most of the students believed 
they had received a large number of definite values from the study of 
emotions. It is probable, however, tiiat no student received a separate 
and distinct value for each item checked, since there is considerable over¬ 
lapping between some items. 

The check-list was fairly comprehensive, and adequate to give the 
students an opportunity to indicate all the values they believed they had 
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Table 1 

Showing check-list on which to iwiictite values received fvom the study of emotiona, 
and the per cent of the 226 aub}ccta who checked each item. 

Diicctiona: Put a check in the blank space before each statement of n vsluo yo\i ha\o 
received from the study of emotiona. If-you have received a value for which there is 
no statement, write out a statemont of the value in the place provided by a blank 
numboP under each heading. 

I. General Values 

Per Cent 
Who 
Checked 
Item 

74.4 1. It boa given me a better conception of emotions; learned wlmt emotions 

are and what they involve; gained insight into ray own emotional life. 

78.8 2- Learned when, emotions occur, that emotions aro tbo natural result of 

strong stimulation. 

G2.8 3. Learned to look ot my own emotional problems objectively. 

32.2 4. Learned that emotions aro goveroed through tho nutonomic nervous 

Bystom. 

74.3 6. Study of emotions has been interesting and inforroativo. 

43.0 6. Learned about a factor that has greatly influenced sludont life. 

71.7 7. Discovered that psychology has some practical values right now. 

29.2 8. Improved my own general happiness through improved adjustment. 

42.Q Q. Established a firm background on which to base fcclingB and altitudes. 

- 10 .* 

II. Development of Emotions 

56.7 11. Learned that the aim in emotional dovclopraenb should bo to direct and 

control rather than to inhibit emotions. 

31.4 12. Learaed that there is a native "core" of omolional behavior. 

82.3 13. Learned that emotions arc behavior, honco subject to change and develop¬ 

ment, especially through learning. 

77.4 14. Learned that other people have a great influonce upon our emotional 

development. 

40.3 16, Discovered some good ways/jneans of emotional development. 

83.6 16, Learned that emotions can bo recognized, understood, and then corrected, 

or directed and controlled. 

63.1 17. Learned what should bo emphasized in the emotional education of children. 

51.3 18. Learned that emotional re-cducatioD is possible; learned about emotional 

re-educalioo, including the methods for removing undesirable emotional 
traits, 

40.0 10. It has taught mo which trails to avoid and which ones to attompt to 

attain. 

36.4 20. Learned how emetioDS aro difforeutiated. 

64.9 21. Learned how emotions are estabUBbed and developed. 

45.1 22. Set up new goals; am now striving to emulate the standard of emotional 

stability set up in the course; I will try to meet tho next set-back with 6rm 
resolution and not give way to emotion. 

- 23 .* 



Values Students Reported from Study of Emotions 
Table 1—Continued 


3S1 


Per Cent 
Who 
Checked 
Item 

74.3 

63.1 

60.8 

83.0 


7Q.1 


70.8 

aio 

54.0 

27.4 
69.2 
06.4 

77.4 


66.9 

60.B 

50.4 

38.5 
78.3 


62.8 


30.5 

60.0 

39.4 


III. Role of IDmotiona in General Adjaatmonfc 

24. a. Emotiona as Motives, Learned that emotiona serve as motives. 

26. 6. Emotiona oa Motives. This study motivated me to bettor cUorta 

toward more wholesome emotional living. 

23. Learned that emotions serve os fscllltatora and Inliibitora of behavior in 
general. 

27. Learned that a successful life must be founded on a fitm emotional basis; 
a aucceaslul life ie greatiy dependent upon emotioDal stability and emo¬ 
tional maturity. 

2B. Helped me to see the important role they play in cur livea. 

29. * 

IV. Values Connected with the Ejqjerimcntnl Study of Emotions 

30. Learned that emotioiB cannot be judged from facial oxptesBiona. 

31. Learned that the study of emotions is inccmplcta. 

32. Awakened a new interest in the further study of emotiona. 

33. Learned how to mcEisure cmationa, 

34. Discovered the difficulty of messuring emotiona experimentally. 

35. Made mo more aworo of emotiona, viz., just what occurs in emotional 
action. 

30. Learned how closely related are fear, joy, and rage in the effect on the 
body. 

87.* 

V. Influence of the Study of Emotiona upon Holationahipa with Others 

38. Made stvidcnt more tolerant of other people's conditions. I am now not 
as apt to criticize friends of mine. 

39. Improved my adiustment to oth<v peopbi 

40. Developed better insight into the emotional life of other people; I am 
better nblo to help them. 

41. Enabled me to aid anobber person to overcome an emotional depression. 

42. I am able to look at others’ reactions more objectively. 

43. * 

VI, Values Connected with Emotional Maturity 

44. Learned what constitutes emotional maturity, hcncc can work toward it 
now, I know what is expected of me no a college student. I realize the 
attributes possessed by the emotionally mature person. 

45. It helped me to tie toother all the loose ends in order to make more con¬ 
crete ray pliilosophy of life. 

40. Aided student to recognize her limitiitiona and powers. I have discov¬ 
ered where I fall short in being emotionally mature. 

47. Discovered pause of poor adjustment to be emotional immaturity and 
instnbility, and learned what to do about them, 
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Per Cent 
Wlio 
Checked 
Item 

72.1 48. Learned gome oI the causes ol omotioiinl immaturity. 

18.6 49. Helped me to emancipate raysoU from my liorao. 

79.6 50. I have scon the importance of bring cmoUonaHy mature and staWo. 

53.5 61. Learned some of tlie necessary ways of solving children's probloma, 

Learned how to help tlicia become emotionally mature. 

- 62.* 

VII. Values Connected with Emotional Stability 

56.2 53. Learned what constitutes cinjotieoal stability, and how to work toward it. 

It is very helpful to know what makes a person emotionally stable and 
how to acciuire these thin^. 

40.7 54. Learned means of emotional cootrol/rcstraiat. 

73.0 55. Learned that if a person will do something about a troublcaoine situation 

ho will worry less. 

32.7 66. I have gained fuller mastery of myself; attained greater emotional sta¬ 

bility, 

31.4 67. Learned how to overcome unfortunate moods. 

81,9 68. Learned how important it is to your health and well-being bo be emotion¬ 

ally stable. 

- 6Q.* 

Vlir. Special Individual Benefits 

13.6 60. Helped mo through an mnolional crisis. 

25.2 61. Aided iri improving rifiriemsy in study and woTk. 

79.2 62. Learned that my emoidooal problems are not unique, but probably many 

others have them. 

70.8 63. Leorned that intense emotion may be harmful. 

28.8 64. Lost queer notions, fear and apprehension regarding emotions. 

23.9 65. Helped me to quit emolionslly colored thinking. 

64.2 • 66. Learned that most fears are unnecessaiy and handicapping, 

40.3 87. Evolved the practice of being honest with myeolf os well os with others, 

64.6 68, Study of emotions mode me think and wonder about myself. 

33.2 69. The study of emotions has made me more hopeful. 

67.3 70. Learned that the fodalcxpressiona of others arc noba safe guide to conduct. 

60,0 71. Learned some steps to take in solving emotional problems and will be 

better prepared to meet emergency situations. 

- 72.* 


IX. Negative or Questionable Values 

17,3 73. Tlje study of emotions has had very little effect on mo os a person. 

- 74.+ 

* Items numbered 10, 23, 29, 37, 43, 62, 69, 72, and 74 provided an opportunity to 
write in statements of values received not given in the questionnaire. 
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received from the study of emotions. Only four new items were listed 
by write-ins in the spaces provided for such additions. The remainder 
of the total of thirteen write-ins were criticisms of the course in psy¬ 
chology, or restatements of items already in the check-list, 

All students did not secure significant values from the study of emo¬ 
tions. Seventeen per cent indicated that they had been helped very little 
by the study. 


Some Conclusions and Criticisms 

1. The method used in this study is in many ways subjective in nature, 
hence liable to errors which could not be checked on either as to their 
presence or degree. For example, many of the stated values which the 
students say they have reedved may be amply verbalizations not ac¬ 
companied by real changes in the personalities and adjustments of the 
students, This weakness is indicated by the fact that some subjects 
checked a number of items as values received, but checked also the 
statement to the effect that the study of emotions had had very little 
effect on them as persons. But the fact still remains that more than 80% 
of the group indicated without reservation that they had received many 
positive values from the study of emotions. 

2. The findings presented here repr^ent the reactions of students 
in one university only where the first course in psychology is taught with 
a certain emphasis. In other universities where the first course is 
taught ivith a diHerent emphasis, the responses of students might differ 
greatly from these. 

3. This survey is a preliminary one, as it obviously must be, since the 
number of subjects is small. The emphasis upon the general benefits 
received from a course of study, rather than simply upon the knowledge 
of facts secured from it, is healthy, and the technique employed here 
appears to be a useful one. In this connection it should be pointed out 
that the values listed by the students were about equally divided between 
those which were strictly a matter of acquired knowledge and those which 
were of the nature of some new skill, changed viewpoint, better method 
of adjustment, etc. But the average per cent of the group who checked 
the knowledge values was 05, whereas the average per cent checking the 
other values was 48%. 

4. Even though 80% of the students said they received many values 
from the study of emotions in elementary psychology, something should 
be done to reduce the percentage of students who say they get little or 
no benefit from it. In this University over three-fourths of the students 
who take the first course in psychology in normal times do not go on to 
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higher courses. The first course is often psychology's lust chance to 
bring benefits into the Uvea of studenta through classroom instruction. 

Received September 18, WU- 
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Aircraft Recognition; L The Relative Efficiency of 
Teaching Procedures * 

Lester Luborsky 

Ditke Utiiiieraiiy 

Thus far the teaching of aircredt recognition has not been subjected 
to any reported experimentally-controlled analysis of learning product 
or comparison of teaching techniquea.^ The present Navy recognition 
program is based largely upon the groundwork of general principles arising 
from tho research of Renshaw of Ohio State and his students, Schwarzbek 
(8), Knight (3), and others (1, 2, 6, 10).* Their experiments led to such 
current emphases in recognition training aa high speed presentation and 
perceptual learning of wholes rather than verbal learning of parts. 
Verbal learning of parts is emphamzed in the WEFT system in which the 
characteristics of 4 main parts, the wings, engine, fuselage, and tail 
are memorized. 

The standard instructional procedure—which has proved highly 
successful—used in most Navy recognition gchools is somewhat as follows: 
When new planes are first introduced the shutter is set on "time” ex¬ 
posure—^i.e., the shutter remains open and the airplane on the projection 
screen is visible until the plunger is pressed again—while good recognition 
features are pointed out by the instructor. Then, in the regular practice 
sessions which follow, the views ore exposed for a short period, from 1” 
to 1/50”, depending upon the particular school, and identification is made 
by the student. After each such identification, except during testa, the 
same view is reexposed for 3”-10” and reidentified and discussed. It is 
thought beat to use a large number of different views of each plane. 
The number of different views varies from 5 to 6, to a new view each 
time the plane is shown. The most usual rate of introducing new planes 
is 2 planes per session.^ 

* Part of a theaia eubmitted in pardal fulfillment of the requirements for the degree 
of Doctor of Philosophy in the Graduate School of A.tta and Sciences of Duke Univer- 
aity, 1946. Grateful acknowledgment ia made of the aasiatance of two membora of the 
Depaitment of Psychology, Duke Utuversity: Dr. Karl Zener for eponeorahip of the 
project, and to Dr. Sigmund Koch for yaluable advice. 

* Since completion of this experiment a summary of the research by Staff, Psycho¬ 
logical Test Film Unit (0) has reported work on aapects of training procedures related to 
those dealt with in the present report. 

* For valuable discussion of current training techniques and for access to claaaes the 
author is indebted to Lt. Comdr. H. L. Hamilton, Lt. W. C. Schwarzbek, and Lt. 
Comdr. R. H. Bruce of the U. S. Navy Pre-Flight School, Chapel Hill, North Carolina. 
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Hensha’w and later workers developed the present program em¬ 
pirically on the baais of their past research findings. As a consequence, 
many clifferencca in practice resulted, such as the variation in use of 
training exposures from 1/60" nt some schools to 1" at others. Vari¬ 
ability also occurs in the number of views presented and in the rate of 
teacliing new planes. 

It thus seemed desirable to test the rchitive effectiveness of several 
present differences in practice, and, in general, to subiect a number of 
major variables of the training technique to experimental analysia. In 
brief, the object of the experiment was to determine, n.s exlmustively as 
possible, the effect of 4 ba.sic variations of aircraft identification instruc¬ 
tional procedure on the total learning behavior of equated classes of 
subjects, The design of the experiment was essentially: 

1. The administration of a battery of tests calculated (a) to measure 
possible perceptual and ienming factors associated with "aircraft identifi¬ 
cation ability” and (6) to aid in equating the groups for possible factors 
affeeting trainability. 

2. The actual training of 4 equated groups under different instruc¬ 
tional conditions. 

3. The administration of an extensive battery of post-training tests 
in order to facilitate more complete analysis of the learning product for 
the 4 groups. 

The resulting data offer the opportunity for analysis of many of the 
determinants of aircraft recognition ability. The present report will be 
restricted to the major question of the relative eflicicncy of performance 
as a function of 4 training techniques. A future article will take up the 
role of other factors, including the span of apprehension, various measures 
of visual memory, and a fuller treatment of reaction time. 

Procedure 

Four equated groups, 8 Navy students in each (6 in Group I), were 
taught aircraft recognition in a standardized manner for 45 minutes on 
Monday, Wednesday, and Friday for a 6 week period in May-June 1944, 
For 3 of these groups one different experimental condition was varied. 

The experimental groups were designed to compare the effects of two 
kinds of short exposure,* 1/50" vs. 1", both used in conjunction with 
approximately the same number of long exposures of the same stimuli 
(Group I vs. Group the presentation of a large vs. a limited number 

^Forthe purposes of eimprioity, exposure dmo will bo called 1/50" and I", although 
tho calibration values give ali^tly dltFercnt results (ace A.pparatua, p. 389). 

<Tho total number of 1/50" cxposurca givon to Group I was approximately 195 up 
to and including Test 9. An approximately equal number of exposures between 1/10" 
and 1/60" were given in testa before the 1/50" epeed was attained. 
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of views (Group I vs, Group II); and the alow introduction of new planes 
vs. a rapid introduction, followed hy review of confused planes (Group 
I vs. Group IV). In other respects an attempt was made to make the 
procedures comparable to those most frequently used in Navy recognition 
schools. For all groups in which tests were given at 1/50^^ during train¬ 
ing, the speed was attained by progressively reducing the exposure time 
during tests from one session to the next—starting at 1" at the beginning 
of the second week and reaching 1/50^^ by the last session of the third 
week. At each session three new planes were taught until, by the middle 
of the fourth week, 33 planes had been presented. By the end of the 
training period approximately 8 different view^ of each plane were used. 

In Group II tlie exposure time and other variables were similar to 
Group I except that the number of views of each plane was limited to 
3 diagram views, Group III was given 1'' exposures and Group I, 
1/50" exposures during tests. As Avill be indicated below in the descrip¬ 
tion of training procedure, exposures for review and teaching were longer. 

In Group IV an answer was sought to the question of the effect of 
teaching new stimulus material at almost twice the usual rate and then, 
after completing the syllabus, giving special instruction on the most 
frequently confused stimuli. As part of this special instruction, the most 
frequently confu-sed jffanea were shown simultaneously on tlie screen and 
differentiation features stressed. When a large group of difficult homo¬ 
geneous views were reviewed in this manner, as e.g,, hcad-on-views of 
singh engme Sghter planes, the students sJeetehed tljese ivhiJe learning. 

Training Procedure. Training, as described in the paragraph below, 
is composed of all the procodurca which were directed toward the sub¬ 
jects' learning of the present aircraft i*ecognition task. Training includes 
the frequent aircraft recognition tests and the review which followed 
these tests during which each plane was reexposed Training also in¬ 
cludes the teaching of new planes and the review following this tcacliing, 
and the home .study done by each subject. The paragraph below de¬ 
scribes the training aspects of a typical session. In addition to this, 
training continues outside of class in home study. All groups were 
given tlic same general training procedures, with the exception of the 
experimental training variables mentioned above (exposure time on 
tests, number of views of each plane, and the rate of introducing new 
planes). 

During the first 3 minutes required for dark adaptation, announce¬ 
ments were made of scores in the last test, etc. Then a test was given of 
planes taught up to that session in which subjects recorded the name of 
each plane on a specially lined mimeographed sheet. This required 10 
to 18 minutes, depending upon the number of planes, which increased in 
successive tests as training was continued. The rate of presentation 
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was 4 per minute. The experimenter, by watching the face of a largo 
sweep-second hand clock, maintained a rather constant presentation 
tempo. All planes in this test were then reviewed for instructional 
purposes on time exposure. The time exposures were approximately 
3" to 6". The subjects called out the name of each plane and were 
corrected when necessary. Subjects* questions were answered at this 
time to avoid making the review too mechanical. In the last 4 training 
sessions and in the "trnining-ir* ® sessions, the exposure time during 
this review was changed from about to one or more 1/10" exposures 

in order to give more practice with short exposures. For Group III the 
review exposure time was changed to 1" at this time. The number of 
presentations in this review was determined by the number needed to 
equalize the total number of presentations for each group for the entire 
course, e.g., Group IV was given fewer since more planes were covered 
in each session. Approximately 3 minutes were then devoted to the 
teaching of each new plane. The head-on, plan, and side diagrams were 
viewed in succession, and good recognition features were emphaaized by 
the instructor. After each view, iMuindera were given to attempt a. vis¬ 
ualization of the plane from all angles, to avoid irrelevant cues, and to 
make outline sketches while learning the plane. In the early part of the 
course, some suggestions for efficient study had been given and these were 
frequently reiterated. In addition, an interest item was mentioned for 
each plane, suoli as its use, or an example of its outstanding performance. 
The new planes were then reviewed on time exposure while the class 
called out the code number and name. Exposures were then speeded 
up to' about 1/5" in the latter part of this review. For Group III, how¬ 
ever, no exposures less than 1" were given. 

Following the 4 week training period, for which the instructional 
procedures have been described above, was a 2 week test and "troining- 
II'* period. During these 2 weeks trainiug was continued except that 
now all classes were given identical teats and trained to the conditions 
of Control Group I, i.e., all groups were given 1/50" training, and picture 
as well as diagram views were included. In this 2 week period, 3 main 
trainjng-II tests were given: Test 10, Test 11, and the Final Test. These 
tests will be described later in the section called "Testa of Recognition 
Performance during Traiaing." Other tests were also given in other 
sessions of the training-II period, which will be referred to as "post¬ 
tests" in contradistinction to the "pre-teats." These post-tests were 
either repetitions of the pre-tests or testa of other aspects of the learning 
product. 

To achieve uniformity in the use of study materials, all students were 

* See paragraph following. 
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supplied with two standard aircraft recognition books (6, 7) and required 
to avoid any other material. A questionnaire on study methods filled 
in by the students near the termination of the training period shows that 
in general these books were the only material used. 

Apparatus 

The 8 subjects in each gi’oup were seated about 6 feet from a projec¬ 
tion screen. A constant seating position was maintained for each sub¬ 
ject. The arrangement of seats was such that 4 subjects sat slightly 
out of the center line. This probably did not influence the pre- and 
post-tests or the rate of learning, since an analysis by seating position 
shows no differences related to seating. The experimenter operated a 
Baloptican, with an attachmont supporting an iris-diaphragm shutter. 
This apparatus was placed immediately behind the students, Stimulus 
cards were fitted into a specially constructed postcard holder ° which 
permitted ready changing of cards—in as short a time as 4 seconds. 
When the ready signal was given, the subjects fixated the center of the 
screen, and immediately after, the exposure was released by pressing the 
shutter-plunger. 

Photographic calibration of the shutter was performed twice before 
and once after the experiment. The shutter speeds called l/SO" and I” 
in this experiment gave calibiution values of 1/40'''' and 4/5"''' respectively. 
Percentage changes from before to after the experiment were less than 6%. 

Two sets of screen illumination readings were taken with a Macbeth 
Illuminometer. One set was taken with the room in semi-darkened 
condition and the other with the shutter opened on time exposure (with 
a blank card in the Baloptican). In the semi-darkened condition the 
screen reflected evenly 0.28 foot candles from a 15 Watt gooseneck lamp 
in the center of the room. The subjects recorded their responses to tests 
in this low light. The screen reflected evenly 2,55 foot candles of light 
when the shutter was open on time exposure. This was the illumination 
reflected from the screen when a plane was sliown. 

Twenty-five American and 11 British planes were selected for the 
syllabus because of their frequent use in combat. 

Comparison of Group Scores 

What is the effect of each of the experimental variables on the learning 
of each group? The complete data for training-I and training-U tests 

* This postcard holder wtig constructed with a thin slot through which the stimuluB 
card could be slipped in place for projection without the necessity of removing the post¬ 
card holder from its position beneath the Baloptican to cliangc stimulus cards. 
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are given in Figure 1. The actual per cent correct Bcores for 5 of these 
tests which are especially important are given in Tabic lA, The first 
of these, Average of Testa 1 and 2, may indicnic the amount of the 
differences existing between groups before training. Test 9 indicates 
the effect of the ex])crimcntal variables when tested under the conditions 
of these experimental variables. Test 10 is the jno.st important test of all 
since it is given to all groups under identical conditions immediately after 

% 



Pig, 1, Per cent correct scores on 9 training-! teats and 3 training-!! teats. (See 
text,) The i upper score curves for training-!! teste were given at 1" exijosure and 
tliQ lower at, 1/50. 


completion of training-I and reveals most clearly the differential effects 
produced by the different training procediii'cs. Test 11 and the Final 
Test are important in showing the consistency of the differences, but 
measure only residual effects of the training procedures, In the more 
detailed presentation to follow, the scores on Test 10 arc italicized to 
emphasize their importance. 

1. Limiiaiion in Number oj Views: Groitp I vs. Group II. A com¬ 
parison of scores for Group I (tlic 1/50" exposure group) and Group II 
(the limited-view group) indicates a small but consistent inferiority in 
Group II. Scores (per cents correct) on Average of Tests 1 and 2 and 





Aircraft Recognition: I 


391 


Table lA 


Per Cent Correct Scores on Two Tmining-I and Three Training-II Tests 


. cm , Training-I Tests Tmining-II Teats 

Av, of Testa 

land2 Test9 Tost 10 Test 11 Pinal Test 

Exposure 

Time 1" 1/60" 1/50" 1" 1/SO" 1" 1/50" 1"**+ 

Group 


I 

.76 

.61 

.65 

.71 

.60 

.73 

.50 

.80 

ir 

.76 

.05 

.46 

.67 

.58 

.67 

.63 

.68 

III 

.81 

.82* 

.59 

,87 

.64 

.85 

.61 

.83 

IV 

.80 

.62 

.06** 

,83 

.67 

.80 

.62 

,80 


* Group III waa given 1" exposure. 

Two weeks had elapsed between completion of syllabus and this test because of 
tho accelerated achedule for introducing new planes. 

f** This teat may be aomewhat less reliable than the others since scores wo based on 
fl, teat of only tea planca. 


Table IB Table 10 


Per Cent Correct of Picture and Di^am Views Ilccpgnibion Time for Pianos 
for each 1/50" Training-II Test (recoi'ded on the planes in 

Test 10 In l/OO'^unita) 



Test 10 

Tost 11 

Final Tost 

Rocog, 

Time 

Group 

Pio. 

Diag. 

Pio. 

Ding, 

Pio, 

Diag. 

Group 


I 

.60 

.60 

,65 

.64 

.48 

.62 

I 

09.7 

11 

.28 

.63 

.62 

.63 

.48 

.58 

II 

66.0 

III 

.62 

,07 

,05 

.62 

.58 

.04 

III 

64,3 

IV 

.58 

.74 

.60 

.68 

.61 

.63 

IV 

61.1 


the three 1/50'’’' training-II tests are respectively as followsi Group I, 
75, 35, 60, and 50%, Group II, 75, 45, 50 and 53%. The reliability 
coefficients of the differences between groups as indicated by I ratios are 
all greater than the 5% level of significance. (See Table 2.) For the 
1" training-II testg, however, scores for Group I are somewhat better 
than for Group II. The reliability coefficients of the differences are 
again above the 5% level, but all favor Group I. 

Analysis of the percentages of picture vs. diagram views recognized 
correctly on Test 10, Test 11, and Final Tests (see Table IB) reveals the 
source of Group II's low scores as due to poorer performance on picture 
as compared with diagram views. In Test 10, scores for diagram views 
are almost the same whereas for picture views the scores are 50% vs. 
28% for Groups I and II respectively. Of course, the particular picture 
views used were completely new to both groups, the past difference in 
training being that Group I (and other groups) had had practice with 





392 hosier Luhorsky 

other views and Group II had had only the three stereotyped diagram 
views. 

2. Exposure Time: Group I vs. Group III. Group III (the 1" 
exposure group) appears to be somewhat fliiperior to Group I, On 
Average of Testa 1 and 2 and the three 1/50" training-II tests^ scores 
for Groups I and III are 75, 55, CO and 50% and 81, 69, G4, and 01% 
respectively. The Gorresponding i ratios are statistically unicliablQ 
but all favor Group III. 

Another aspect of the relative efficiency of performance of Groups I 
and III can be measured in terms of recognition time. Tliis comparison 
should be important because proponents of the use of 1/50" exposures in 
training may maintain that there arc other advantages which do not 
emerge from comparisons of per cent correct seorcs, especially the im¬ 
portant advantage of more rapid recognition. In Tost 10, given immedi¬ 
ately after completion of training, subjects were required to indicate 
recognition by lifting their forefinger from a response key in circuit with 
a standard timer. The name of the plane, given verbally by the subject, 
was recorded by an assistant. The results in Table 1C show conclusively 
that an advantage for Group I in recognition speed did not exist. Fur¬ 
thermore, accuracy and speed of recognition in Test 10 for all subjects 
proved to be uncorrelatcd (r = — .16). 

3. Rate cf Introduction of New Planes: Group I vs. Group IV. Group 
IV (the rapid-pi'Csentation-pluB-rcvicw group) is superior to Group I. 
Scores on Average of Tests 1 and 2 and the three 1/50" training-II tests 
were 80, 66, 07, and 02%, ns against corresponding values of 75, 56, 60, 
and 50% for Group I. The t ratios for the differences between Groups 
I and IV on training-II tests arc 1.83, 1.31, and 2.29. Although only 
the last of these is significant at the 5% level, the direction of all of them 
favors Group IV. 

A second, and obviously related aspect of the results concerns the 
intorcomparison of all groups. Groups III and IV give the best results 
of all 4 groups. After completion of the 4 weeks training period, it was 
found that Group III did os well as both Groups I and II at 1/50" 
exposures (Test 10) even though no previous training on planes at il50'' 
had been given. Furthermore, Group III did somewhat better on this 
test than any other group with 1" exposures. Group IV seems to be 
slightly better on the Final Teat at both 1/50" and 1" than any other 
group. The t ratios for the differences between Groups II and III on 
the three 1/50" tmining-II testa are 1.4.1, 0.83, and 1,25, and for the 
Groups II and IV they are 2.49, 1.59, ond 1.95. 

Final evaluation of the differences in this section depends upon the 
reliability of the differences and the comparability of groups which are 
discussed below. 
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Reliability of Differences 

How much confidence can be placed in the obtained differences? 
Since the number of subjects in each group is small and the absolute 
values of many of the differences not particularly great careful consider¬ 
ation muat be given this question. 


Table 2 

Reliability of DiHorcncea Between all Groups on Averagp of Tests 1 and 2 and 
Traimng-U Tesla {t ratios) • 


Group 

Av. Testa 
land 2 

1" 

Teat 10 

1/60" 1'' 

Test 11 

1/60" 1" 

Final Test 
1/50" 1" 

I 

II 

O.OQ 

1,20 

0.33 

0.23 

0.80 

0.48 

1.23 

I 

III 

0.87 

0.51 

1.60 

0.68 

1.90 

1,62 

0.31 

I 

IV 

0,73 

1.83 

1.10 

1.81 

2.14 

2.29 

0.82 

II 

III 

1.01 

1,41 

3.04 

0.S3 

2.40 

1.26 

1.60 

II 

IV 

0.70 

2.49 

2.96 

1.67 

2.66 

1.96 

2.12 

III 

IV 

0.14 

0.80 

0.03 

0.82 

0.28 

0.20 

0.63 


* If underlined the differooco is within the 5% lovo! of signiiicaacc, i.e., greater than 
2.17 for those diCfcroncee involving Group I and greater than 2.14 for others. 

Table 2 presents the / ratios for the differences emerging from inter- 
compariaon of tho performance of all groups on the Average of Testa 
1 and 2 and the 3 crucial training-II tests for 1/50" and 1" exposures. 

Although these reliability measures for the moat port are not sta¬ 
tistically significant, examination of Figure 1 will reveal that the results 
show a consistent direction. It is this consistency of direction which 
suggests that the main differences, i.e., those between the first 2 and the 
second 2 groups, may be real ones. 

Comparability of Groups 

More important than statistical reliability in the case of such small 
groups is the question of the rigor of equation of all variables other than 
the experimental ones, The groups were relatively satisfactorily equated 
before training for 2 factors witli evident importance for trainability— 
intelligence and previous knowledge of planes. The results of this 
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equation will bo prosentod in Table 3 together with the results of tests 
of the otlier factoia which might have been I'egponsiblc for differences in, 
the tminfibiiily ()f the groups. In the following list of these factors, 
tlie name of the inoasuro alone gives some suggestion as to the nature of 
the measure, A complete description of each will be given in another 
rGport(4). Theliatis:!. Intelligence (A. C. E.); 2, Previous Knowledge 
oS PJijjjag; 3. GymloB hi AcaAGinic WorJe iorVrovwus Bomcaier; 4-. Home 
Study Time for Airciaffc Jlccognition; 5. Acuity (Snellen Symbol E 
Chart); G. Interest I; 7. Interest II (Improvement); 8. Peaetion Time 
(Lig)it Flnsli; Common Objects; Airplanes); 9. Span of Apprehension, 
1/50"; 10. Momory-Locatioii, 1/50"; 11. Memory-Complex Figures, 
Part 1 1/50"; 12. Memory-Complex Figures, Part 2 1/50"; 13. Memory- 
Complex Figures, 5"; and 14. Memory-Aircraft Kecognition Aspects, 
1/50". 

Although the differcnceg between groups on the above tests (see 
Table 2) appear small enough to disregard if taken singly, Group I and 
to a lesser extent Group II, are lower on several teats (Memory-Complex 
Figures 6" and Memory-Complex Figures, Part I, 1/50") which have 
been found (4) to be important in delCTraining final level of performance. 
Since the effect of these differences is not determinable, the differences 
between groups in aircraft recognition tests must be somewhat larger 
to be meaningful tlmn they otiierwise would have to be. This will 
primarily affect the conclusions based upon Group I va. G'oup III. 

Other differences not covered by the above measures may have 
existed. For example, the difforencea in group scores obtained on 
Average of Tests 1 and 2, ranging from 0% to 6%, possibly were not 
produced by the experimental variables in training procedure, although 
these variables may have slightly affected the scores of Group IV and 
Group II. This may be a crucial criticism. However, a reanalysis of 
the data on the basis of a re-equation of groups shows tliat it does not 
materially affect the results. The re-equation was carried out in the 
following mannert Average of Teats 1 and 2 scores of 4 subjects, one from 
each group, were selected on the basis of how nearly they were alike. It 
was possible to find one low, high, low-middle, and high-middle score 
which was almost the same in each group. The means of these 4 sets 
of scores, one for encJi group, did not differ mere than Q.5%, These re¬ 
equated group-means on Average of Trats I and 2 were then compared 
with the mean of the same 4 subjects on Test 10, Test 11, and the Final 
Test. Virtually the same relative differences among the scores were 
obtained as with the original data. The re-equated Group IV, however, 
was slightly higher on the Final Test. 
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Discussion 

A number of suggestions for optimum training procedure may bo 
immediately inferred from our results: 

1. Group n procedure seems to be the least efficient. Therefore 
teaching materials which are restricted to only 3 diagram views of each 
plane, as are those of many spotters’ couises, are disadvantageous for 
proper learning, and cause difficulty in recognizing other, more life-like 
views 

2. A training procedure including tests at exposures varying from 
1" to 1/50” has no evident advantages over a procedure having no 
exposures shorter than 1” (Group I vs. Group III). The slight apparent 
superiority of Group III on aircraft recognition tests is difficult to evaluate 
because of the email initial Buperiovity of thie group on Average of Tests 
1 and 2 and on some of the pre-tests which ore correlated highly with 
final level of performance. There are three possible interpretations to 
the failure of Group I to show any superiority over Group III on Test 10 
which constituted the first experience of thie group with 1/50” exposures. 
There may, in fact, actually be no Bpecial skill for seeing under short 
exposure conditions. The development of such a skill may not readily 
occur in the abaence of conditions permitting operation of the law of 
effect, that is, more immediate identification of the plane verbally or by 
re-expoaurc for a longer time. Or lastly, a longer period of training with 
1/50" exposures, as is usually found in recognition programs, may bo 
necessary, 

The data presented in the next article (4) would enable a more com¬ 
plete equation of groups than was possible before this experiment and 
would open the way to a definite answer to the problem. 

Since the speeds tested in the present experiment are within the range 
considered short exposure, they offer no direct implications as to the 
relative advantages of short vs. long exposures. (Long exposures are 
here considered as 3 to 10 seconds.) Possibly some combination of long 
and short exposures may be more efficient than predominant use of either. 
This technique is employed in some recognition schools. In addition, 
more consistent and definitive use was made of the 1" and 1/50” exposures 
than is usual in current practice. Consequently, this afforded clearer 
insight into the effects of these procedures. 

3. New planes can be learned at almost twice the usual rate with no 
impairment in efficiency, in comparable length of time to the other 
teaching procedures, by the rapid-prcsentation-plua-review procedure, 

’In addition, there ecenia to bo a greater tendency to use inadequate and trick 
recognition features. A.t the end of the couiso etudenba were asked to confess any 
trick cues they had been using. Group II seemed to excel in their use. 
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There ia strongly suggestive evidence that it is the most effective of the 
procedures used, Its superiority may be the result of a longer period 
of time during which all planes have been seen and a longer period of 
time for stressing those planes which present the most difficult differentia¬ 
tion problems. 

Since the procedures for Group III and IV were found to be most 
efficient, a combination of both might give greater efficiency than either 
one separately. This i.s one interesting possibility for further research. 

Summary and Conclusions 

Four equated groups, of 8 pre-aviation (V-5) students each, were 
taught aircraft recognition in a standardized manner. The major 
experimental variable in each group was as follows: Group I, l/SO" 
exposure time; Group II, only three views of each plane; Group III, 1^' 
exposure time; and Group IV, presentation of the entire syllabus in 
almost half the usual time, followed by a review emphasizing confused 
planes. 

The following conclusions were obtained. 

1. The use of 1/50" exposures as part of training in which an ap¬ 
proximately equal number of longer exposures are given has no 
ascertainable advantages over 1" exposures similarly given with 
longer expo.sures. 

2. Restriction of teaching materiak to only three views of each plane 
results in learning which generEilizes poorly to views of planes 
other than those taught and is, in this sense, inefficient. 

3. Rapid teaching followed by review of confused planes is probably 
the most efficient of the procedures tested. 

These findings might be useful for incorporation in actual training 
courses. 

The battery of tests which was found (4) to be important for deter¬ 
mining the final level of performance will now make possible a more 
complete equation of groups and thereforo future experiments which can 
yield more definite answers to problems such as the above. 

Received October 18, 1044- 
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Magazine vs. Personal Interview Votes in the Consumer 
Jury Advertising Test 

Lester Guest 
The Pennsylvania Slate Cdleye 

For many years the eonsiimer jury or opinion method of testing the 
effectiveness of advertisements has been a useful device for estimating 
the relative effectiveness of advertisements before they appear. In 
essence, respondents are usually pereonally interviewed and asked which 
of several advertisements interests them the most or would most likely 
influence them to buy. 

The completeness of the make-up of the advertisements at the time of 
the test, the number of advertisements that can be judged at one time, 
and the form of the question posed the respondent have all been subjected 
to research (1) (3),^ It has been conceded that, as in all sampling studies, 
the sample should be representative of the purchasers or potential 
purchasers of the product in question. The final answers to some of the 
other problems await some sort of definitive criterion of effectiveness. 
However, assuming that respondents’ stated preferences are automatically 
valid for the degree to which they would be likely to read an advertise¬ 
ment, some questions can be tentatively answered. 

In regard to Die form of the question, the consensus seems to indicate 
that respondents should be asked to select the advertisement which 
appeals to them the most, or that interests them the most, or the adver¬ 
tisement that would most likely lead them to buy, rather than asking 
them to select the dest advertisement (2, p. 309) (3, p, 124), (There ai-e 
those who say that the wording makes little, if any, difference (1, p.‘ 18).) 
The reason for this distinction in que.«tion wording arises from the belief 
that the interviewee should be asked to react to the advertisement as 
a consumer and not as a critic of advertising. From the current point of 
view, there is no tci’t advertisement apart from the reader’s own prefer¬ 
ence, From a practical point of view, it makes no difference whether 
the advertising expert believes that a certain advertisement has the best 
headline, general layout, and illustration, if the public concerned dislikes 
that advertisement and prefers another. Therefore, the question asked 
the respondent should not lead the respondent to believe that he is 

‘ Unpublished data from several sources also give inforraation on these points, 
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matching -wits with experts, but should let him fed free to react as he 
usually acta, not as he should act. 

With respect to sampling problems, it h«s been .shown that coupon or 
mail responses arc not usually leprcscntative of the general population 
or of a specific mailed sampling. Thm is sometimc.s due to dilution or 
inflation caused by the habitual coupon clipper, or even more discon¬ 
certing, the inertia of the temporarily disiiiterc.sied indiiddiial or the over- 
zealous individual who lias a special interest in the problem at hand. In 
addition, Link (3) points out tlrnt mail inquiries allow respondents too 
much time for critical evaluation which may lend to distortion. 

The author recently had an opportunity to study the following 
questions in respect to consumer jury responses: (1) what effect docs the 
form of the question have upon preference for an ndvertisement, and (2) 
what differences, if any, result from a comparison of magazine ballots 
vs, personal interview ballots? 


Procedure 

The advertiaements in question were printed in the interests of a well 
known, nationally distributed drug product. The original advertise¬ 
ment in reality consisted of two advertisements placed side by side on a 
full page of a national magazine. The headline of the complete ad¬ 
vertisement asked the reader to indicate which ad he or she voted for, 
with a small subscript challenging the reader to "match wits with the 
experts.” The two advertisements then appeared, followed by a short 
bit of copy and a coupon. In return for the reader's reply, lie was to 
receive a free sample of the product. These two advertisements will be 
referred to as A and B. Advertisement B subsequently appeared singly 
in three other national magazines, but Advertisement A never appeared 
elsewhere. 

The double advertisement asked the reader which advertisement 
was the heiler. In order that coupon replies and personal interview 
replies be comparable it was imperative that the personal interview 
question also ask which advertisement was better. However, it was 
tiiought desirable to check the influence of wording the question in this 
fashion with wording believed to be more appropriate, i.o. "most inter¬ 
esting.” Therefore, the questionnaire was constructed with this aim 
in view. 

Two forms of the questionnaire were constructed, each asking for 
data concerned with usage of the product, iceognition of the advertise¬ 
ments, and readership of the magazine in wliich the advertisements 
originally appeared. In addition, each pei'son was asked wliicii ad¬ 
vertisement interested him more and which advertisement he thought 
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was better. On Form A of the questionnaire, the "interest” question 
preceded the "better” question, and on Form B the order of these two 
questions was revorsed. Other than this, the two forms were identical. 
Additional data were secured bearing upon the respondent’s age, sex, and 
economic status. 

Proofs of the original advertisement were obtained and by appropriate 
cutting were made into two separate advertisements, each as they might 
appear singly, Tlmse were presented to the respondent simultaneously, 
but the right-left position was systematically varied to avoid any time- 
order error. In the original magasine appearance this was of course 
impossible. 

A total of 304 interviews were conducted by experienced interviewers. 
These were done about 2 months after the appearance of the original 
advertisement and were stratified into the conventional A, B, C, and D 
economic groups. Half of the interviews were done with each form of the 
questionnaire, and half were done with each sex. No attempt was made 
to control the age distribution, although the approximate age was noted 
for each interviewee. Geographically, the interviews were done in cities 
and small towns distributed along the eastern coast. 

Several internal checks of the data indicate that the sample was 
reasonably representative. For example, although no effort was made 
to intei’view the some number of men and women with each form of the 
questionnaire, about one-half men and one-half women were found to 
have been interviewed with each form. Similarly, although economic 
status for the whole 304 interviews was stratified, no attempt was made 
to stratify within one questionnaire form. However, approximately the 
correct proportions were maintained by form of the questionnaire. 
Finally, about the same number of users of some brand of the product 
were found to have been interviewed with each form of the questionnaire. 

Eesults 

The data presented in Tables 1 and 2 refer to the material collected 
from all interviews irrespective of the form of the questionnaire used. 
Cases where respondents refused to choc^e between the two advertise¬ 
ments have been eliminated throughout to facilitate comparisons, 
These coii8tit\itcd only 10% to 12% of the cases and their elimination 
did not materially change the results. The category "interesting” 
always will refer to the question phrased using that word, and the category 
"better” will refer to the question using the word better. Table 1 indi¬ 
cates that in all comparisons Ad A was judged superior regardless of the 
question asked or the way the data were collected. A’s superiority 
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Table 1 

Per Cent for each AdvcrLiacmcnt in Total lolerview Group and Coupon Group 

Ad A Ad B N 


Personal Interview 


IntweaLing 

63% 

'17% 

2G6 

Better 

5S% 


274 

Coupon 




Bottci' 

5a% 

41% 

230 


Table 2 

Per Cent for oacli AdvcrtiRcmcnt According to Economic Status, Sox, and 
Uao of some Brand of the Product * 


More Interesting Better 




Ad A 

AdD 

N 

Ad A 

AdB 

/V 


A 

59% 

41% 

29 

55% 

45% 

20 

Economic 

D 

61% 

49% 

63 

60% 

40% 

57 

Status 

C 

52% 

48% 

104 

57% 

43% 

107 


D 

54% 

46% 

80 

67% 

43% 

81 

Sex 

Male 

55% 

45% 

125 

60% 

40% 

131 

Fomnlo 

61% 

49% 

140 

55% 

46% 

142 

Uso of somo 

Users 

50% 

60% 

103 

54% 

46% 

lOG 

brand of Lire 

Non-uscre 

56% 

45% 

103 

60% 

40% 

16Q 


product 


* Only 3% of the total group of respondents used the brand of the product udverLised 
and therefore this group wua considered loo small for nny atatislicnl anulyais. 


increaaes when “better" was asked in the personal interview and agrees 
closely with coupon returns in this case. 

In no ease, however, did the critical ratios between these differences 
reach 3. The difference of 18% in favor of Ad A in terms of coupon 
returns yields a critical ratio of 2,83, or over 99 chances in 100 that the 
difference is not the result of sampling errors. Likewise, the difference 
of 16 in favor of Ad A from the personal interview returns when “better’' 
was asked gives 99 chances in 100 that the difference ia not tlic result 
of sampling errors. 

When the data are fractionated for economic status, sex, and use of 
some brand of the product, tlic base N's become too small to yield any 
statistically significant differences. Ilowevcr, such brcalcdowns can give 
suggestions as to the possible groups from which coupons were returned 
in order that Ad A receive 59% of the votes. Therefore, these data are 
presented in Table 2, 
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Some of these percentages agree quite closely with coupon returns, 
for example, the percentage of men picking Ad A as better, the non-uaers 
picking Ad A as better, and the B economic group selecting Ad A as 
better. From this, it looks os if coupons might have been returned with 
a greater frequency from men, the B economic group, and non-users 
of the product, otherwise coupon returns would not agree as well with 
personal interview data. As a matter of fact, it is known that coupons 
were returned with men’s signatures more frequently than with wonien''s 
signatures when the coupon returns were broken down for sex, 60% of 
men prefer Ad A and 55% of women prefer the same advertisement. 
This agrees perfectly with the interview data for sex on the same form 
of the question. The coupons did not contain data allowing other 
fractionations. 

It will be recalled that on one form of the questionnaire, "interest” 
was aslced first followed by "better” and that this procedure was reversed 
on the other form. The previous tables present the data grouped by 
question form but aummating responses irrespective of the order of the 
questions. To make the most legitimate comparison with coupon re- 
turns it is necessary to consider only responses to the question asking 
which advertisement is better on the personal interview questionnaire, 
iinbiaaod by a previo\is question asking which advertisement is more 
interesting. To do this, responses were tabulated separately for Form 
B of the questionnaire and only for the question asking for the "better” 
advertisement. This question appeared fii'st on this form. Table 3 
gives these results. 

Table 3 

For Cent for each Advertisement According to Economic Status, Sex, and Use of the 

Product for the "Better" Question Only and When it Appeared First (Form B) 


Total Groups 
Ad A 
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Here again, the N’s are much too small to yield any statistically 
significant differences but the results shown here suggest that coupons 
probably were returned most heavily from the B economic group in order 
that 59% of magazine voters could have selected Ad A. On the whole, 
it is probable that coupon responses overestimate the "superiority" of 
Ad A even in terms of "betternesa.” (The critical ratio of the difference 
of 18% in favor of Ad A yielded by magazine votes is 2.83 whereas the 
critical ratio of the difference of 6% in favor of Ad A yielded by personal 
intevview results is .70.) 

Another factor that could have led to the large majority of coupon 
responders selecting Ad A was the fact that Ad A always appeared on the 
left position in the magazine whereas the right-left position was alternated 
in the personal intevview. Other studies have shown the influence of 
time-order error and it is conceivable that it operated in this instance (1). 

It is obvious that differences arise not only from the form of tho 
question but also from the effect early questions in the questionnaire 
have upon other subsequent questions. Table 4 presents material upon 
this factor. 


Table 4 

Influence of the Order of Questions upon Preference for tin Advertisement 



Torm A 



rorm B 




A 

B 

N 

A 

B 

A 

Interest (Ist) 

66% 



Better (Isb) 63% 

47% 

135 

Bettor (2nd) 

63% 



Intcreat {2nd) 61% 


134 


The material in this table shows again that Ad A is superior in every 
comparison, but the degree of superiority varies depending upon the 
context of the question. It se^s that from a pure interest point of 
view, Ad A is picked by 10% more people than Ad B, but when followed 
by a question referring to “better," Ad A’s superiority jumps to 26%. 
(The critical ratio of the latter difference ia 3.17. In all other com¬ 
parisons in Table 4 the critical ratio approached zero.) On the other 
hand, if "better” ia asked first, followed by "interest,” the change is only 
from 6% to 2% in favor of Ad A, It looks here as if, once a person has 
said that an advertisement is better, there is less likelihood of his turning 
about-face and choosing another advertisement as more inteicsiing, but 
if he has picked an advertisement as more interesting, then ia confronted 
with a question inferring that there ia such a thing ns a "better” advertise¬ 
ment, he may be more prone to change hie choice. The data presented 
in Table 5 indicate that the large majority of people do not change their 
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original selection, but that those who do (d)ange materially alter results 
for the total group. 

Out of 152 answers to Form A, 107 made no change, and out of 152 
answers to Form B, 109 persons made no change, Therefore, the ap¬ 
pearance of either question before the other is not especially conducive 
to change of choice. However, considering only those that changed 
preference, when better precedes interest, the changes were about evenly 
split, whereas, when interest precedes better, twice as many persons 
change to Ad A ns change to Ad B. (The critical ratio in the latter 

Table 5 

Major Cliangcs in Choice of Advertisement by Form of tho Questionnaire 


Form A Form B 

(Interest—hotter) (Bettei;—interest) 


Chaagea to 

Changes to 


Changes to 

Changea to 


B when asked 

A when naked 

N 

B when asked 

A when aaked 

A 

‘‘better" 

‘‘better" 


“interest" 

"interest" 


33% 

G0% 

45 

49% 

61% 

43 


instance with only 45 cases is 2.37.) Evidently, there are some factors 
in Ad A that respondents who oiiginaJJy select B as interesting feel 
experts agree upon as better. What those factors are is not obvious 
from the present analysis. 

An interesting commentary concerning the whole study is that al¬ 
though Ad A always gathered the majority of the votes (sometimes 
small), Ad A was never published as a separate advertisement, whereas 
Ad B ran separately three times. This supports the contention that the 
copy writer, although ho may be an excellent Judge of an advertisement 
for himself or a small number of people like him, may not estimate in 
advance which of several advertisements will please the majority of the 
reading public with which he is reolly most concerned (3). 

Conclusions 

Any conclusions drawn must of necessity be interpreted in the light 
of the fact that, due to tho relatively small number of cases interviewed, 
most of the differences do not yield critical ratios of 3 or more. However, 
in several of the more pertinent comparisons, the chances are greater 
than 90 in 100 that tha obtained differences ai*e not due to sarnpUng 
errors. Itemembering the limitations of the study, the following con¬ 
clusions may be drawn. 
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1. A comparison of the results of a consumer jury test carried out by 
magazine votes with one carried on by personal interview indicates that 
the two give diflerent results. Magazine returns indicated 59% for 
Ad A whereas the most legitimate comparison figure for the personal 
interview group was 53% for Ad A. The critical ratio of the difference 
is 1.12, or 87 chances in 100 that the difference cannot be explained in 
terms of sampling errors. At leant one other study has shown ii similar 
discrepancy (3, p. 119). 

2. The differences found between magazine and personal interview 
results may be a result of unrepresentative sampling of coupon responses. 
It appears that the middle economic groups' responses more nearly 
approximate coupon returns than other groupings. The magazine in 
which the original advertisement appeared would tend to be read by the 
top economic groups more than tlic lower groups. 

3. There is a possibility that a time-order error may be introduced 
in magazine voting and that this can be balanced out by a properly 
controlled personal interview study. 

4. The form of the question has an important bearing upon results 
obtained. Different responses are obtained when a person ia asked to 
select the better of two advertisements than when he is asked to choose 
the one that interests him the most. It is likely that the latter form 
will give a truer picture of him as a consumer than the former form. 

5. For some people, the answers to a question will be unduly influenced 
by preceding questions and answers. 

Riceived September 5,19^, 


Eeferences 

1, Advertising Research PoimdatioiL Copy leolinq. N. Y.: Ronald Press, 1939. 

Ch, 1, 

2, Jenhins, John G. Psychology in hisineasardindMtry. N.Y.: Wiley, 1935. 

3, Link, H, C. The new psychology of aeUing and advtrlimg. N. Y.; Macmillan, 1938, 

Ch. 0. 



Book Reviews 


Woolpert, E. D. [Ed.] Municipal Personnel Administration. (3rd 
edition.) Chicago: International City'Managers' Assoc.; 1942. Pp 
xU-l- 429. S7.50. 

Municipalities and other iurisdictiona entertaining the idea of installing a personnel 
Byatcm, contemplating the institution of m in-service training program or seeking a 
comprehensive; realistic guide to worhable aolutions of personnel problems should 
consult Municipal Personnel Adminisltaliort. This book is published by the Interna¬ 
tional City Managers' Association as the ninth volume of ita series on municipal 
administration. 

While public officials arc inclined to be interested in specific problems, rather than 
general practices and trends, they should be ever mindful of the need for perspective 
and long-range policies and prograroB, Accordingly, this volume consists of more than 
expedient devices for the practitioner. The first chapter on the personnel problem 
does just this by providing a broad background and a setting for the more specific 
diacusaions of personnel problems which cncorapoK the remainder of the volurao. 

The need for a rational organization of porBOnncl activities ie the first specific per¬ 
sonnel problem considered. It is indicated that the dimengiona and complexity of this 
problem require positive, concerted effort for effective solution. A basic requirement 
for dealing adecjuately with tbia pemonnel problem is to have defined clearly the respon¬ 
sibility for the administration of such acUvitios. This personnel problem exists even 
in tho Smaller cities where it is not always feasible to Imve c. separate personnel agency. 
However, it is pointed out that these cities must recognize regardless of working force 
the exiatencQ of such problems os cloasificotion, rates of pay, recruitment, hours of work, 
attendance, and leaves of absence. 'The text outlines severe! ways whereby these 
municipalities can meet their personnel problems. The dominant theme is that varia¬ 
tions in structural patterns of personnel organization should not bo taken seriously as 
long na they result from the application of sound general principles to different local 
situations. The basic problem of organization is solved when tho work is analyzed and 
the methods and resources available are considered and evaluated, 

In the ensuing several chapters where the principal phases of personnel administra¬ 
tion are considered, on attempt has been made to outline standards of administration na 
guidepoflta for individual personnel agencies. In liio chapter on position.-clas.sification, 
it is shown that information relative to the duties and responsibilities attached to tho 
various individual positions within a pven service is of primary importance in the 
development of a personnel program. Accordingly a position-classification plan de¬ 
signed to secure and utilize these facta should be one of the first aims in preparing and 
administering a personnel program. After stating the nature and objectives of position- 
classification, serious attention is given to the develt^ment of a classificotion plan, the 
problems entailed in introducing tho plan, and the basic requisite of continuous adminis¬ 
tration of the plan. 

In a concise, yet complete, chapter oa salary and wage administration, it is shown 
that the intangible advantages of public employment about balance the disadvantages. 
A workable outline is presented for Ihoac seeking to attain the principal objective of a 
pay plan—equal pay for equal work. 
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In Chapter 5 the reader finda an objective discusaon of problema involved in the 
recruitment and selection of qualified personnel for public service. After indicating 
the relation of recruitment to classification, there is presented the various forms and 
methods of examining or testing applicants in selecting employees with a capacity to 
learn. In logical sequence there follows a chapter on employee training in which there 
is found most of the elemunts entailed in the organization for and methods of training. 
The point is made that the appropriate method of triuning should be dcLormined prag¬ 
matically, on the basis of utility and applicability. In Chapter 7, considerable attention 
is given to the metiiods of appraising, through promotional test, the capacity of em¬ 
ployees for promotion, Pei'sonnei administratoi's arc reminded Hint tliero is nn inverse 
relationship between the need for specific knowledge, the factor wliidi a wcll-construclcd 
examination can measure reliably, and the level in the organimtional hierarchy which 
an employee occupies. The liighcr one goes in the Mganizational ladder the greater 
should be tire emphasis Upon capacity for administration. 

The problem of reports of performance is treated in an unbiased manner. Tlio 
evaluation of employees is regarded os an essential part of administration since it is 
quite common to find disparity between abiKty and performance, In any balanced 
personnel program determination ol knowledge, nkills, and aptitudes should be supple¬ 
mented by measures of employee performance. Various types of rating systems are 
described and an effort made to evaluate the degree of auecesa found with each. The 
analytic checklist type Bccms to be favored because it tends to climinaLo the weakness 
of evaluation by the rating officer prevalent in the graphic rating scales. 

What has been presented to Uiis point is regarded as tho elccleton of an effective 
personnel program, Tho chapter on morale and conditions of employment includes 
other elements which enter into such a program enabling it to give maximum service to 
tho community. The quality of supervision within an oi'ganization is presented os blio 
most important factor in building and maintaimos high morale. Closely related to 
the question of morale is the complex matter of discipline. While favoring some form 
of disciplinary process, similar to the enaployce self-discipline plan inaugurated in the 
refuse collection division of the Los Angeles city government, responsible officials are 
cautioned against copying without disei'inaination this or any other plan os a general 
model. Since self-diBcipUnc can beat be developed and maiutainud through llic organi¬ 
zation of employees themselves, the following chapter on employee relations delves into 
tho many ramifications of the personal equation in administration, particularly as they 
relate to tho development of a municipal employee relation policy. As the final element 
of a compteheneive personnel program, Chapter 12 goes into the ramiflcatioiia of a 
properly planned and administered retirement system. While the personnel adminis¬ 
trator docs not usually administer the retirement system, it is advised that he participate 
in the planning phases because it plays an importent part in the development and 
maintenanco of effective government. 

After covering the broad background from recruitment to retirement, Chapter 13, 
entitled "Special Administrative X^blema," presents several aspects or phases of per¬ 
sonnel administration which have to do with the ovemll administration of a personnel 
program, rather than with tiie program per se. They include such items as personnel 
rules and regulations, personnel forms and records, research, measurement, and public 
relations. 

Practitioners, namely administrators, personnel psychologists, and heads of oper¬ 
ating departments and agencica, will find the book extremely valuable in developing 
workalile solutions of personnel problems. The approach is primarily utilitarian, with 
emphasis upon day-to-day personnel problems which confront tlio aforementioned. 
The discussions in the book have achieved a high degree of realism through a process of 
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selecting carefully specific problenoa, teclmiquea and piocedures derived from tho 
authors' own experienceg and observations. In all the disoussione there is do pretenso 
of presenting a detailed manual or a model system of municipal administration. 

The tone and outlook of tho book in generij is objective and practical. The object 
is not to BUggcab complete overhaulinE of personnel administration overnight wlicro 
obvious disparity exists between accepted Btondards and practices in given organiza¬ 
tions. Instead, the personnel officcrismadc to realize that ehangeafor the improvement 
of public service must be introduced by progressive steps. 

Progressive municipal oJhcialB and persoiinel psychologists can hardly afford to do 
without this volume designed aa a practical guide. Tho general administrator will find 
it very useful in delineating the principal techniquea derived by personnel experts and 
learning the relationship between these techniques and management problems confront¬ 
ing tho chief administrator and his deportment heads. Tho personnel officer will find 
the text indispensable for two reasopB: first, the principles and activities of a compre¬ 
hensive personnel program are developed from discussions of the personnel problem; 
and second, the position of personnel admiiustration in the broader framework of ad¬ 
ministrative management is portrayed quite effectively. In addition, students of mu¬ 
nicipal administration, particularly those interested in public service careers, will find 
the book most profitable in obtaining a bolaaced picture of the interests and approaches 
of the administrator and the personnel officer. 

John K. McKay 

Cali^omia State Personnel Boojfi 


Melville, S. Donald. Color viaion, Reprinted from The Oplamdric 
Weekly, August 24, August 31, September 7, and September 14, 1944, 
pp. 19. 

The author of this article has given a condensed version of tho physiology and the 
psychology of color viaion. In most respects the sources cited ore up to date and ade¬ 
quately evaluated. However, the field is one in which bo much activity is going on 
currently that one slvould be careful to accept any orystallization as final. The psy¬ 
chology of color is not given as a psychologist probably would give it, who is porticulnrly 
interested in the field, but it touches upon most of the facta. 

The article works up to. a final topic which is probably of considerable interest to 
readers of the Weekly, namely, abnormal color vifflon ond tests for color viaion. Most 
of the current tests arc described briefly but no thorough-going evaluation is attempted. 
The only new material is derived from some testa by the author on tlie treatment of 
color blind individuals. His interpretation of these results is in line with other studies 
which give no indication that color blindness can be altered by dietary or training 
methods. A list of 89 references is appended, which, while not exhaustive, gives a good 
samphng of the field. Undoubtedly the article answers very well the purpose for which 
it was written, namely, that of infonning a particular group of professional men con¬ 
cerning a field related to their profession. 

Forrest Lee Dimmick 

Hoharl College, 

Geneva, New York 
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MacKintoshj J. M. The mr and menial heallk in England. New York: 

The ConimonweaJfcli Fund, 1944. Pp, 91. $.85. 

This book coiisisLa of a scries of iDfonnal essays on isicntal health in Rngland during 
the first four years of tlio present World War mid Llic outlook for the Poat-Wiir period. 
Part Ono entitled The impact of war covers The process of adjuslmcnl, 1939-/,0, The 
lonely year, Wj^O- 41, Defense, preparation and allianK, 194l-/i2, and The end of the 
hcfjinnitid, lS4£-^3. Part Two entitled Mid}ilizalionfor peace covers Hospital services, 
Volnniarp organizaiions for menial hcalih, Professional education in mental kcallh, and 
Some problems of the fulure, Much of Uic content consists of cither anecdotal material 
or generalizations for which little supporting data arc introduced, The general point 
of view that scientific services, mental health, education and propaganda can make a 
great contribution both to wai- and peace U one with which few will disagree, But 
the professional person, however rnucli ho may enjoy the style /ind manner of presenta¬ 
tion, may well fool that tlic book is somewhat vague and over-optimistic with regard 
to the conbributiona that can be made and quite lacking in concreteness and specificity 
oa to their character. 

John E. Anderson 

Vniversity of Minnesota 
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The Accuracy of Precision Instrument Measurement 
in Industrial Inspection * 

C. H. Lawshe, Jr., and Joseph Tiffin 

DiviBion of Educalion^ and Applied Payehology, Purdue University 

Modern induatrial production is becoming more and more dependent 
upon the accuracy of precision instrument inspection. Thousands of 
employees have been trained in the use of precision measuring instru¬ 
ments, and future industrial developments almost certainly will require 
still greater emphasis on the accuracy of measurement to insure produc¬ 
tion which satisfies the fine tolerances of modern precision equipment. 
Virtually every precision instrument calls upon the operator to exercise 
judgment in determining proper’ “feel,” “tension,” “drag,” or other char¬ 
acteristics. In spite of all that is known about the variability of human 
judgments, little attention has been given to the importance of such 
variability os it may affect the accuracy of precision instrument measure¬ 
ment. The purpose of the investigation reported in the present paper 
was to examine the accuracy and variability of employee measurements 
with certain precision instruments. 

SouTces of Data. Data were collected in two different plants. The 
first of these is engaged in the manufacture of variable pitch propellers 
for aircraft and the second in the manufacture of precision parts for 
aircraft and automobile engines. There is no evidence that the survey 
results obtained are any better or any worse than those whioli would be 
obtained in other plants of a similar character and there is every reason 
to believe that similar results would be obtained if the survey were 
projected to other plants. 

An Inspection Department Survey 

Joh Analysis. Approximately 200 people are employed in the inspec¬ 
tion department of the first plant. Their jobs were analyzed by job 

* The authors ocknowledgo the ossistanco of Mr. 0. D, Laacoe in establishing tho 
“triio'’ dimensions and of Mr. R. N. PurccH in doing most of the atatiaticoi work in 
connection with the second part of tho study. 
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classifications in order to determine what precision instruments are used 
and what tolerances arc demanded on each job. Frequency counts were 
then made to determine which inatrumonts or combinations of instru¬ 
ments are used in the largest number of clasaifications and by the largest 
number of employees. On the basis of this count, twenty instruments 
and combinations were chosen aa being moat important in this particular 
plant. 

A Dimensional Control Laboratory. A room was set aside as a dimen¬ 
sional conti'ol laboratory and twenty booths or inspection stations were 
set up. Each booth was numbered and in it were placed one of the 
twenty instruments, a standard part from the plant, and a simplified 
working drawing which indicated one dimension to be measured with the 
instrument provided. When an employee entered the room, the attend¬ 
ant determined his job classification and provided him with an appro¬ 
priate work-sheet for each of the stations containing work samples from 
his job. Each employee waa tested on only those instruments which ho 
uses on his particular job. He was encouraged to make five measure¬ 
ments and then to record his best judgment as to the dimension. The 
readings thus obtained were compared with so-called "true” dimensions 
which were determined by means of ultropprecision instruments in com¬ 
bination with Johanaon blooka. Inafcruinents utilized in the performance 
testing were checked and adjusted periodically to insure constancy. 

Emphasis of Testing. This performance testing procedure was organ¬ 
ized in connection with a training program and its primary function was 
to identify persons in need of training. Plans for a maintenance pro¬ 
gram were also made with provisions for re-teating employees every three 
months. It was also planned to utilize the laboratory to supplement 
seniority in determining adequacy in connection with transfers and pro¬ 
motions. The program was instituted wth the knowledge and backing 
of line supervision and of the union in the plant. There is every reason 
to believe that nearly all of the employees approaches the test situation 
with a favorable attitude. 

Results 

Results obtained at eleven of the twenty stations are presented in 
Figure 1. The particular stations selected for illustration wore chosen 
in terms of general familiarity with the instruments used and nob because 
of ony peculiarity in the findings; they are truly representative. 

In Figure 1, the open bars represent the percentage of inspectors 
tested who obtained readings within the established tolerance, The solid 
bars represent the percentage of persons tested who failed to meet the 
standard. As already stated, not all of the inspectors were tested at each 
station; instead, the sample contains only those who use the instruments 
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on their jobs. This accounts for the fact that the N’b range from 117 
to 162. The figure indicates that the percentage of inspectors meeting 
the various standards ranged from a high of 66% on the inside microm- 
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Fig. 1. The percentage of inspectors passing and failing various precision incHauriTig 
instrument performance tests in an oircraft propeller plant. The open bars indicate the 
percentage meeting the standard and the solid bora indicate the percentage failing. 


eter to a low of 9% on the inside caliper in combination with the six-inch 
micrometer. The pattern of performance on the various vernier microm¬ 
eters also seems significant. It will be noted that 43% of those tested 
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met the standard with the one-inch micrometer, 17% with the two-inch, 
and only 11% with the six-inch. The varying tolerances established for 
the instruments are the same as the tolerances which job analyses indi¬ 
cated had been established by the engineering department niid are 
identical with those encountered in tlie shop. 

A Tool Room Sui*vcy 

Procedure. Because many of the employees in the plant just de¬ 
scribed were new and were drawn from a "tight” labor market, a related 



Tia. 2. The percentage of toolmakers {N — 45) who obtained vernier micrometer 
mcosvircments within .0001 inch of the "true*' dimension on each of nineteen parts. 
The base line indicates the approximate size of the dimcQBion and the code indicates 
the shape of the part mcasared. 

study dealing with experienced toolmakers was set up in a plant engaged 
in the manufacture of precision parts for aircraft and automobile engines. 
In this study, 45 men were selected from the tool room. Their ages 
ranged from 17 to 62 years, their experience with the company from five 
to twenty-nine months, and their experience on their present jobs from 
one to twenty-nine months. For the moat part, the job classifications 
of these men fall in higher labor grades than do those reported in the 
inspection department study. 

The study was limited to the use of vernier micrometers and employed 
nineteen parts to be measured. Five parts were cylindrical, five rectan¬ 
gular, five spherical, and four were inside diameters. Here again, each 
employee measured each part independently five times and the reading 
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recorded wag the beat judgment he could make aa to the "true” reading 
on the basis of these trials, After all readings had been completed by 
all of the men, the parts were measured with ultra-precision instruments 
and Johansen blocks in order to obtain tlie closest possible approxima¬ 
tions to the "true” dimensions against which to compare the measure¬ 
ments made by the men. 

Accuracy Results. No significant correlations were found between 
accuracy of measurement and either age, length of experience with the 
company, or amount of time on the present job. The percentages of 
accuracy are shown in Figure 2. On the baseline of this figure is plotted 

U) 

o 
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Tio. 3. The varisbility of tho vernier micrometer raeaeureinents of 4& toolmakerfl 
OD each of nincteoQ parts. The hose line indicates tho approximate size of Uis dimen¬ 
sion and the code indicates the shape of tho part mcoBured. 

the approximate size of the part. On the vertical axis is plotted the 
percentage of readings correct to .0001 inch. It will be noted that the 
parts very in size from approximately inch to approximately 6)^ 
inches. Each of the four lines plotted in Figure 2 shows the percentage 
of readings within ,0001 inch of the "true” dimensions for parts of a 
certain shape according to the code indicated in the figure. Thus, for 
cylindrical parts, about inch in size, 73% of the readings were accu¬ 
rate to .0001 inch. For cylindrical parts approximately 3 inches in size, 
however, only 12% of the readings were accurate to .0001 inch. 

Varidbiliiy Results. The results plotted in Figure 2 assume the accu¬ 
racy of the so-called "true” dimension. The validity of these “true” 
dimensions is always open to question in spite of the ultra-precision 
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methods used. Therefore the data were analyzed in another way to 
show the variability of the readings obtained witliout reference to the 
"true’^ dimensions. This analysis of the results is plotted in Figure 3. 
Here again the approximate size of the piirt in inches is plotted on the 
baseline, The vertical axis on tlris chart plots the interquartile range of 
the readings. This may be interpreted to mean the range of the middle 
60% of the readings under each condition of siJic and .shiiiic of the part. 
For example, looking at the solid line plotted in Figure 3, it will be noted 
that when the part is cylindrical and approximately }/z i^^cli in size the 
interquartile range of readings, or the middle 50%, is .0002 inch. This 
means that 50% of the i-eadings were within a range of ,0002 whereas 
the remaining 50% of the readings varied by more than ,0002, either 
above or below of the range of the middle 50%. In like fashion, it will 
be noted that when the part is cylindrical and approximately 2^ inches 
in size, the middle 60% of the readings fall within a range of .0003, 
whereas the remaining 50% of the readings on this part fall more than 
,0003, one way or the other, from this range. 

Summary and Conclusion.^ 

Controlled performance tests with various precision insti-iiments were 
administered in two industrial plants. In one plant 200 inspectors were 
tested on a variety of instruments used in their respective jobs. In the 
other, 45 tool room employees weic tested on vernier mierometera with 
parts of varying sizes and shapes. 

In general, the foUowmg conclusions arc supported: 

l..The accuracy of precision instrument usage is probably consider¬ 
ably lower than is ordinarily assumed by those i’e.sponsiblG for methods 
and standards. In one plant the percentage of ins])ector3 meeting the 
standard ranged from 06% on the u.sc of the inside micrometer to 9% on 
the inside caliper in combination with the six-inch micrometer. 

2. In the population studied, micrometer rending accuracy did not 
correlate significantly with age, amount of experience with the company, 
or length of time on the present job. 

3. Gross size of the part is apparently a factor in the accuracy of 
micrometer measurement. Under optimal conditions in the second plant, 
not move than 80% of the readings were accurate to .0001 inch and with 
larger parts, ranging from 3 to 6 inches, only al)out 20% of the readings 
were accurate within these limits. 

4. Gross size of the dimension is likewise related to the variability of 
measurements. As the parts increase in size, regardless of .shape, the 
spread of the readings becomes greater so that for large inside diameters, 
50% of the readings vary by .0008 inch from the other 50% of the 
readings. 
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5. The results suggest that while inside diameter measurements are 
more variable than measurements of cylindrical, rectangular, or spherical 
dimensions, the percentage of measurements meeting the standard of 
±.0001 inch is no less, However, the problem of the relationship be¬ 
tween shape and both accuracy and variability is open to further 
investigation. 

6. The necessity for the development of training methods that will 
more nearly standardize judgments based on such chai'acteristics as 
“feel," “tension," and “drag" in the use of precision instruments is 
indicated. 

7. The implication ig present that the very nature of the vernier 
micrometer and similar precision measuring instruments is such that one 
should not expect as high a degree of constancy as the average operator, 
supervisor, and standards man has been taught to expect. 

Recmed November SO, 194/i. 



Movement Analysis as an Industrial Training Method * 

Lawrence 6. Lindahl 

Dms/on oj Educoiion otuI jlpplictl Psyc/iolopy, Purtluc ymuersi'tj; 

Many industrial jobs which involve coordination of hand and foot 
movements in operating machines present difficult training problems. 
Typical of such jobs is contact disc cutting. The company producing 
contact discs experienced considerable difficulty in training new operators 
because the majority did not complete the training and for those who 
did, learning was alow and uncertain. Preliminary investigation with 
experimental apparatus indicated that part of the difficulty encountered 
in training new operative personnel was due to the failure to identify 
the form of cutting movement necessary for "getting the feel" of satis¬ 
factory performance of the job. 

The cutoff machino slices thin discs (e.g., .020" X -150'^ diameter 
with ±.002" on both dimensions) from various sizes of tungsten rods 
with a rubber-bonded abrasive wheel .015 of an inch thick and six inches 
in diameter. The cutting wheel turns between closely fitted guides, 
moving up and down between the guides ond across the rods being cut. 
The pTOCeas ia wet cviUing and the wheel is not visible to tho opovator 
while cutting. Most machines cut two rods at a time. 

The operator pushes the rods through guides into stops which regu« 
late the thickness of the discs. Holding the rods firmly against the stops 
with a hand lever, he operates a pedal witli the left foot which controls 
the cutoff wheel as it is applied to the rods. As soon as he cuts through 
the rods he lifts his foot, the wheel rises, and immediately after it has 
cleared the stops n backward jerk of the right hand actuates ejector or 
knock-out pins which knock the severed discs into the stream of water. 
Immediately after the ejection of the discs the rods are pushed back into 
the stops and a new cut is taken. Figure I shows an operator seated ftt 
a machine ready for operating. 

The cutoff machine depends for successful operation upon the speed, 
form, rhythm,.and pressure pattern of the hand and foot action of the 

* Baaed upon a thesis submitted by Liwcenco Guylcrd Lindahl to the Faculty of 
Purduo Univeraty in partial fulfillmont of tho roquireinonta for tho Degree of Doctor 
of Philosophy, October 1944. Acknowledgment is duo Dr. Joseph Tiffin and Dr. C. H. 
Lawsho who jointly directed tho Ksearcb and to Jamgs R, Brock who made tho study 
possible In mdustry. 
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operator. Failure to applj' fool pressure properly results in damage to 
the discs, excessive breakage and use of wheels, and wastage of material, 
The purpose of this study was to analyze the disc cutting operation 
by identifying the form of the foot movement that produced satisfactory 
quantity and quality of discs with minimum cutting wheel usage, and to 
teach this form to new operators by the movement analysis method. 



Fiq. 1. An operator seated ot the disc cutolT maohino ready tor operating. 

The Method 

The A'j)paratus. The mechanical apparatus used for the movement 
analysis included a paper tape recorder with a specially made vvi-iting 
arm attached. A fine tlireacl was fastened to the writing arm and run 
through glass bushings mounted in mettil pieces which were clamped at 
accessible places on the cutoff machines, and thence to the pedal in such 
a manner that the complete cutting .cycle movement could be recorded 
on the paper tape as it moved along at a known speed under the pen. 
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The recorder was placed on a small ^^^(dcd Laltle wliich was i)u.slied from 
machine to inaciiinc and eiieek.s on operators u’oro (/ninlcl.v and accurately 
made without mtcvfevcuee with ))i'(Hlaetiou. Tisui'C. 2 is a schematic 
drawing of the iccoi’cIgi’ attiuilied Lo tlic cutoff niauliiiie, 

Procedure. Tliein-occfliirc consisted first of a job analysis by activity, 
The principal activity, the cutting (iycln, was furtlMM- aindyzod by study’ 
ing the foot action rocordingH of skilled (jperators (.o liuf.l out what con¬ 
stituted good perfori^ianco. 'Hie vccordov was thou used for inslvncUonal 




Fro, 3, Disc cjttcr foot-action pattern of/i good, cxpcrionced o[M;rator, 

This was the accepted ataiulard. 

purposes in the training of new operators and for improving experienced 
operators already on the line. This typo of analysis is not entirely new. 
It was utilized with good results by Tillin and Jlogers (5) in training tin 
plate inspectovs and by English (1) in training riflemen. 

The coordination of the foot action in cutting, with the hand action 
in placing the rods against the stops and ejecting the discs after cutting, 
constituted the cutting cycle. The cut through the rod was the cutting 
phase and the ejecting of the discs and placing of the rods against the 
stops was the recovery phase. 
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Since the foot action was the principal part of the cutting cycle, the 
main e£fort was given to finding the correct foot action pattern and then 
presenting it to the trainees in an effective manner. 

By recording the patterns of experienced operators and superviaoi's, 
who were also experienced cutters, and comparing the action patterns 
with quantity, quality records, and abrasive wheel usage records, it was 
possible to identify the “standard” or correct pattern. There were wide 
variations in action patterns of the experienced operators showing the 
existence of individual differences, but the consistent pattern was there 



Fig. 4. An enlarged view of disc cutting showing ita principal parts. 

to form the basis on which the noted differences could be explained. 
Figure 3 shows the foot action pattern accepted as standard. All sizes 
of rods gave the same pattern, but spacing of cuts was wider for large 
rods because of longer cutting time. The correct pattern showed a good 
reverse cutting curve which indicated unhurried, steady cutting with 
“feel" of rod. The operator checlred his foot at the same place on every 
cut just as he cut through the rod by easing the pressure, thus allowing 
the wheel to cut its way through without making burrs. The short 
follow-through at the bottom indicated, in shop parlance, a “soft'’ foot. 
The recovery started soon after cutting through, saving time for each cut 
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and allowing plenty of time to coordinate or time the ejection of the disca 
and place the rods back against the stops ready for the next cut. The 
operator paced the mncliinc and adjusted his time for the cutting part of 
the cycle to the speed at which the wheel could cut best without forcing 
or crowding the wheel. To force or crowd the wheel results in several 
disc defects, short wheel life, and wear out of the setup. Figure 4 ig an 
enlarged view of one cycle showing the significance of each i)art of the 
cycle. Figure 5 is an incorrect pattern made hy a trainee with only 
4 hours experience. Figure G shows the foot-action patterns of one 
trainee at various stages in the training program. There is a steady 
approach to the standard pattern and a comjdcte story is evident in each 
recording after the various hours of supervised operation. It will be 
noted that the pattern at 239 hours closely resembles the standard pat¬ 
tern shown in Figure 3. 



Fiq. 5, An incorrect disc cutter foot-action pattern. Operator had 
only 4 hours experience. 

Enlarged instructional posters with analytical notations were pre¬ 
pared both for "correct" and "incorrect" patterns and for various types 
of damage to the product which were shown to he reflected in the action 
pattern. Individual action patterns of each operator were kopt in folder 
form also so the operators could note their progress. By careful use of 
the recorder at timely intei-vala with both the trainees and experienced 
operators and by interpreting the foot action patterns in terms of the 
standard, it was possible to reduce the training time of new operators 
and to improve the quality and quantity performance of some employees 
already on the job, 


Results 

Trainees Veisus Old Operators 

Training a group of operators on the production line is not unlike 
breaking in a team of horses, a gi’oup of men for a football team, or a 
squad for the army. All must work together. Especially is this true 
where the operators are working on day rate and a certain amount of 
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production must be obtained each day. One individual cannot do all 
the work no matter how good he ia. The object of the training program 
is, therefoj-e, to get ali of tlie trainees as nearJy alike as possible in the 
shortest time and all aa good and os near like the standard as possible. 





Ml HOURS 



Fiq. 6. Disc cutter foofc-oction patterna of a trainee showing improvement with 
training- The records were mivdo after 9, 45, 141, and 239 hours of supervised 
operation. 

The Bupervisor, or trainer, has to move from operator to operator, check¬ 
ing, helping, comparing, encouraging, correcting, explaining, and expect¬ 
ing progress day by day. If he does not maintain his own interest he 
will not find continued interest in the learners, especially after the 
newness of the job has worn off. He should be interested in tJie group; 
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it ia from the group that he expects to obtain production. It is, there¬ 
fore, on the group that the training program must bo evaluated. Even 
■when all possible attention has been given to the group, individual 
diffei-ences will remain. Tiflin (6) enumerates many kinds of individual 
differences in job qualifications and individual productivity. The person 
doing the training must constantly detect and give due consideration to 
these individual diffci’ences in order to get the entire group to the stage 
of perfection he desires. Equal increments of practice and training do 
not in any sense reduce all trainees to a common level of performance. 
In evaluating the results of a training method on the job where none of 
the variables is controlled, there are factors that prevent one from giving 
too much attention to the production of any one individual, For in¬ 
stance, there are external limitations on the individual’s power to increase 
his output, such as the condition and speed of his machine. One trainee 
may be given credit for less output than onotlier because he was carrying 
an undetected handicap. And even though this handicap ia detected 
there is often no way of eliminating it. The speed of two machines that 
look exactly alike may vary tremendously during different periods of the 
day; or supplies of material or tlic difficulty of the task may set an upper 
limit on individual production which perhaps one-third of the members 
of the group could reach, and no one could bettci', no matter how com¬ 
petent he might be. Age is another factor which has unmeasured effects 
on individual production on the line and makes it noccs-sary to consider 
group differences in evaluating the results of the training program. 

There are numerous ways to evaluate the results of the training once 
it has been put into operation. Lawshe (2) lists 13 methods and from 
such an extensive list one should find a method that fits any particular 
case. 

In machine operations, like disc cutting, jobs have been time-studied, 
rates based on these studies have been set, and production of trainees 
and old workers alike is indicated by the output. In the particular 
operation reported herein training can be evaluated on two factors, 
namely, production performance and wheel performance. Both wheel 
breakage and wheel use are important aspects of wheel performance. 
The two factors are considered to be of equal importance and manage¬ 
ment has set up a rate sheet based on the number of cuts socurecl per 
wheel for a given size of rod and the speed of cutting (production per 
hour). In other words, tho operator must get a specified number of cuts 
per wheel and must cut at such a speed that he will turn out enough units 
in one hour to earn the base rate set per hour. When be gets the exact 
number of cuts per wheel for the rod size he is cutting and cuts just 
enough to earn his hourly rate, he is doing 100% performance in both 
factors, namely, production performance and wheel performance. 
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There are several reasons for emphasiEing wheel performance. One 
is that the special type of wheel used for tungsten disc cutting is very 
expensive and wheel costa can very easily exceed labor costs. Also, a 
bettci Quality of product is obtained by limiting the speed of cutting, 
which is effectively done by placing emphasis on wheel performance. 

Curves arc used to evaluate the effects of this training program. As 
stated by Tiffin (6, 186), ^'such curves, therefore, serve the very useful 
purpose of providing a means of evaluating the successfulness of an 
operator-training iirogram and spotting decisively those operations in 
which training is inadequate, either in quantity or quality.” 

Figure 7 ia the production curve of the trainees for 12 weeks. Pro¬ 
duction performance percentage is plotted on the vertical axis and weeks 
(6 days each) of training on the horizontal axis, Production perform- 



Fig. 7, Production performance percentage of disc cutter trainees. Dotted lines 
represent average production pcrfornianco percennige for first 2 weeks of groups with 
an average of 2, 5, and 9 months experience at start of training. 

ance percentage makes the production performance of all operators 
comparable since it ia computed on. the company rate sheet for the various 
sized rods cut. For instance, if an operator using 6" wheels to cut .142 
inch rods, cuts 12,000 units of rod in 10 hours, he cuts at the rate of 
1,200 units per hour. The rate sheet indicates the operator should cut 
2,340 units per hour to earn the base rate of 65 cents per hour. Since 
1,200 is 51 per cent of 2,340, his production performance is 51 per cent. 
The production performance percentage is, therefore, the average num¬ 
ber of units cut per hour divided by the number of units that the operator 
is expected to cut per hour of the size rod being cut to earn his wage. 

The dotted lines in Figure 7 show the production performance of old 
operators at the .start of the training experiment. There are three groups 
of these old operators. Before the training started, eight operators had 
an average of 2 raontlis, nine operators had an average of 5 months, and 







428 


hawTsnee G. Lindahl 


ten opemtora 9 months experience on the job. The trainee.'^ hnd no 
previous experience. Old operators total 27 and trainees 19. No data 
■were available on the production abilities of the various groups prior to 
the start of training, In order' to obtain a basis of comparison for the 
groups, QU average of the production of tlio first two week.s at the begin¬ 
ning of the training is considered indicative of the ability of the groups 
of old operators at that time. These averages arc sliown on the figure 
by the dotted linos. 

The production cui-ve for the trainees reflects a steady rise. At the 
end of 8 weeks they have surpassed the average of the 2 months group. 
At 11 weeks they exceeded what the 5 months group \vq.s able to do at 
the beginning of the training program. Although their average fell on 
the 12th week, this is not unusual in curves of this type. The general 
trend ia upward and with more confidence, experience, and continued 
training it should be safe to assume that'the curve should reach the top 
limit of the 9 monthe group in much Icag time than 0 months, reaulting 
in saving many man hours of training time. 

One may legitimately inquire about the quality of the discH cut. 
There was no difference in the quality of the discs cut by the trainees 
and by the other groups. The company used a production checker who 
continually checked the discs os th^ wore cut by going from operator 
to operator and it was practically impceaible for any one operator to cut 
a majority of the defective discs. The machine would he shut down or 
the operator's performance investigated to determine the cause of the 
defects, Any shut down would be reflected in the production perform¬ 
ance of the particular operator. Since tungsten is an expensive material, 
it was imperative to keep wastage at the very minimum. One hundred 
per cent inspection of the discs was made after a tumbling operation, but 
this was done according to size of discs and the production of two or three 
operators cutting the aame size rods was usually thrown together. Pro¬ 
duction control regulated the quantity to be cut over any one period. 
In the form of stricter auperviaion thfa control probably served aa a 
forced incentive to the worker. 

Figure 8 ia the wheel performance percentage plotted against weeks 
of training. Tho averagea of the 2, 6, and 9 months groups of old oper¬ 
ators in wheel performance are shown by the dotted lines. These aver¬ 
ages are of the first two weeks performance at tho beginning of the 
program. Wheel performanco percraitage is computed from the rate 
sheet. Heferring to the illustration previously cited, if the operator who 
cut 12,000 discs in 10 hours used, without breaking, 20 of the 5" wheels 
and broke 5 others, he used a total of 25 wheels to cut 12,000 discs. He 
obtained 480 units per wheel. According to the rate sheet, 100 per cent 
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wheel performance on .142 rod requires 470 units per wheel- The wheel 
performance ia 480 divided by 470 or 104 per cent. Wheel performance 
is, therefore, the units the operator gets from each wheel divided by the 
number he should obtain according to the rate sheet for the size of rod 
being cut. Wheels broken must be counted as wheels used, for the 
operator gets some cuts with the wheels before they are broken, Wheel 
performance ia negatively correlated with production performance. The 
faster the cutting the higher the production and the fewer units per wheel. 
This relationship had to be regulated in the training program and empha¬ 
sis placed on cutting according to the cutting curve so that both maximum 
wheel performance and maximum production were obtained. 

The rate sheet is made up on the basis of 100 per cent production 
performance and 100 per cent wheel performance. Figure 8 shows the 
9 months operators at exactly 100 per cent wheel performance while 



Fta. 8. Wheel pcrforoKincc percentage of disc cutter trainees. Dotted lines repre¬ 
sent average wheel porrormnnee porccn(-agc for Brat 2 weeks of groups with an average 
of 2, 5, and 0 months experience at atari of training. 

Figure 7 shows their production performance at 81 per cent. It will be 
observed by reference to Figures 7 and 8 that the trainee curve goes up 
toward 100 per cent production performance and downward toward 100 
per cent wheel performance. 

One must speculate on the sudden upturn in the wheel performance 
curve of the trainees after the 9th week. It can be accounted for to 
some extent at least by the fact that a more rigid accounting of wheels 
used was started nt that time. Some operators had acquired the habit 
of not using all the wheel because of the slower cutting pace due to the 
smaller diameter of tlie wheel as it wore down. These operators changed 
wheels before entirely using them. Tliis lowered the wheel performance 
and took more wheel,9. By requiring operators to turn in every used 
wheel for inspection at the end of the day's run it was possible to deter- 
mino just wliich operators had not entii’cly used their wheels. The gen¬ 
eral effect was that all operators tended to use up their wheels, thus 
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getting higher wheel performance. This might also cause the slightly 
lower production because of slower cutting as the wheel grew smaller. 

The best operator would get as much over 100 per cent wheel per¬ 
formance and ns much over 100 per cent production performance as 
possible. To do this he would have to cut steadily, consistently, and 
carefully during all working time. Failing to do this he could not pos¬ 
sibly get over 100 per cent wheel performance even though he might cut 
fast to make up lost production time, because the faster he would cut the 
lower his wheel performance would become. The interrelationship of 
wheel performance to production pra'formance complicated the training 
problem and made the movement analysis method all the more important. 



Tia. 9. Percentage of wheels broken by disc cutter trainees. Dotted lines repre¬ 
sent average percentage of wheels broken for first 2 weeks by groups with an average 
of 2, 5, and 9 months experience at start of training. 

As haa been noted, this found a standard pattern that laid stress on both 
accuracy and wheel performance. 

Figure 9 shows the percentage of wheels broken plotted against weeks 
of time. Percentage of wheels broken is the fraction of the total number 
of wheels used each week. For instance, the number of wheels used 
Without breaking plus the number broken is the total number used. The 
ratio of the number broken to this total is the percentage broken. If, 
for example, an operator wore out 300 wheels in one week and broke an 
additional 25, he used a total of 325 wheels. The percentage of wheels 
broken during the week is 25 divided by 325, or 7.7, 

Figure 9 shows graphically the trainees’ reduction in wheel breakage 
due to the attention given to the correct cutting method. During the 
first week the trainees broke 24 per cent of their wheels. By the third 
week they were breaking leas than operators having 2 months experience. 
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by the 5th week less than those having 5 months experience; and by the 
10th week less than those having 9 months experience. By the 12th 
week of training the trainees broke only 1.8 per cent of their wheels, or 
about one-third that of the group with 9 months previous experience. 
This is good for two reasons; first, because the wheels were very expensive 
and large savings reaulteci (wheel coat could very easily exceed labor 
coat), and second, all time taken to change broken wheels has to be 
charged against production time. Broken wheels prevent running for a 
period ranging from one minute to sometimes as long as a half hour, 
depending on how long it takes to remove the broken pieces from between 
the guides. 

The higher average wheel performance noted for the trainees is due 
to emphasis being placed on accuracy rather than speed and on correct 
operation, or cutting according to the reverse cutting curve. High wheel 
performance eventually leads to increased production. It insures a 
better quality of product at the beginning with less wastage. The curve 
shows that the trainees steadily reduced their wheel breakage. In Fig¬ 
ures 7, 8, and 9 the trainees show exceptionally fine performance in rela¬ 
tionship to the other three groups of operators who learned by the 
"pick-up” method, Although their production average was lower than 
the 9 montlis group of operators, they steadily increased production, 
their wheel performance was maintained well over 100 per cent, and the 
per cent of wheels broken was considerably reduced, 

Trainees Versus Beginners 

Another way operators learn jobs, probably more prevalent than any 
other learning method in industry, is that of “trial and success.” This 
consists of showing the operator hia job and then "turning him loose” 
to learn in the beat way he can. It is a sort of "sink or swim” propo¬ 
sition. The operator is not led from the beginning by progressive steps 
and has no reliable indication, of hia progress. Such haphazard learning 
usually results in lower efficiency and poor work habits. 

It was possible to obtain records over a period of three weeks of the 
production and the wheel performance of 5 operators who were learning 
the disc cutting operation in just this manner. They are called begin¬ 
ners for purposes of comparison with the trainees who were trained by 
an organized method. The.se beginners did not have the advantage of 
using the movement analysis recorder nor any of the instructional 
material. 

Figures 10, 11, and 12 present a comparison of the production per¬ 
formance, wheel performance, and wheel breakage of beginners and 
trainees at the end of the first, second, and third week of operation on the 
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job. Figurea 10 and 12 do not allow a significant difference between the 
two groups in production performance and percentage of wheels broken. 
Figure 11, however, shows gmphically considerable difference in wheel 
performance percentage between the two groups. Whether the differ¬ 
ence shown can be attributed to chance can be tested statistically by 
finding (t) the significance ratio for the differciiCG in the means of two 



Fia. 10. Production performnnee percentage of disc cutter trnincca and 
bcginncTB for first three wccics. 
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WEEKS OF TRAININO OR EXPEflIEKCC 

Fiq. 11. Wliccl pcrforraance percentage of disc cutter trainees and 
beginners for first three weeks, 

independent small random samples. The smallest difference between 
the two curves occurred at the second week. The significance of this 
difference, therefore, was computed to determine the possible role of 
chance in accounting for the difference between the curves. The .second 
week of training or experience shows a wheel performance percentage 
mean of 129 for the trainees and 86 for the beginners, Substitution in 
the formula (3) for finding the significance ratio for the difference in the 
means of two independent small random samples results in a "I” of 2,548. 
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Eeference to the table of Vb indicates a "i" of 2,518 for 21 degrees of 
freedom is required for the 2 per cent confidence level, The obtained 
difference is therefore significant at the 2 per cent level -which meana 
that there are 98 chances in 100 -that the difference found is not due to 
chance and must therefore be due to the special training given the experi¬ 
mental group. 

Ejfecl of Training Program on Old Operators 
When any training is carried out directly on the production line it is 
bound to have some effect on the experienced operators even though 
most of the attention is directed to the trainees. Studies have been 
made of factory workers in which work conditions of all kinds were 
varied. A noteworthy example ia the experiment carried out in the 
Ha-wthorne plant of the Western Electric Company (4). Its moat impor- 



Fig. 12. Porcontage of wheels bMlraa by dise outlier trainees and 
beginners for first three weeks. 

tant finding was that regardless of the nature of the changes made in 
the working conditions the productivity of the experimental group tended 
ia general to increase. Although the interest and attention undoubtedly 
had a stimulating effect on the old operators, the fact that foot-action 
lecordings and interpretations were made for them as well as the trainees 
would lead one to believe that intere.st and attention did not account for 
the total improvoment. 

One cannot rush \ip to an old operator with a new gadget with the 
expre.9sed purpose of chocking up on him. The cooperation of the old 
operator may be secured, however, by explaining to him the need for 
finding out how the job is done so that it can be taught to the new oper¬ 
ators. Practically every old operator will give the best performance he 
can muster up and is then already on the road to self improvement. One 
can also question the operator about hia work. As soon as the old 
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operator finds that someone is interested in his job he begins to think 
that the job is important after all and ho is likely to take more interest 
in hia work and that of fellow workers. Learning becomes contagious, 
production starts to increase, the entire line improves, and no one but 
the person in charge of the training is aware of it or knows the reason why. 

If those operators who aecin not to want help are ignored for a while 
they will soon seek help either by asking for a recording or by letting it 
be known that their recordings have not been taken. Workers all desire 
to be treated alike. 

A review of the foot-action patterns ‘ shows that old operators used 
a lot of waste motion in cutting and moat of them had not developed the 



Fia. 13. Porcentago of improvomont or loea in wheel pcrformanco, production por- 
formanco, and wheel breakngo reduction for groups having nn average of 2, 5, and 9 
montliB experience on the disc cutoff machine prior to the start of the training program. 

necessary "feel." That they could improve by watching the recorder 
was also shown. 

Figure 13 shows the percentage of improvement or loss in wheel 
performance, production performance, and wheel breakage reduction 
made during training by groups having an average of 2, 5, and 9 months 
of experience on the disc cutoff machine prior to the start of the program. 
The graph is based on averages for the first three weeks and the bust 
three weeks of the traimng period. In computing the percentage of 
improvement or loss, the performance at the start of the program was 
considered 100 per cent. 

All three of the groups broke fewer wheels after the training was under 
way. The 5 months group made the greatest improvement by breaking 
69 per cent fewer wheels than they did at the start, the 9 months group 

* Coco studies and complete presentation of data will be found in tlic appendix of a 
thosis by the author on file in the librnry of Purdue Univoraity. 
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40 per cent less, and tho 2 inontha group 32 per cent less. Reduction in 
wheel breakage effected a substantial saving in wheel costs over the 
period. 

The 5 months group improved their production performance 21 per 
cent but suffered a loss of li per cent in wheel performance. Since 
production performance is negatively correlated with wheel performance 
and both are of ecpml importance, this represents total improvement and 
reflects the emphasis ])hi.ccd on wheel perfoiTnance by the movement 
analysis method, Lilce.wise the 2 and 9 months groups improved their 
wheel performance by 28 and 6 per cent, respectively, at the expense of 
production by only G and 5 per cent. Again with wheel performance 
and production performance of equal importance this vepresenta sub¬ 
stantial improvement. 

Tlie total picture is good when one considers the nature of the opera¬ 
tion, that it is a hand and foot coordinated operation which requires the 
human operator to function with mechanical precision over long periods 
of time, and that old opej'ators may have learned ns many bad habits as 
good, necessitating unlcarnmg before starting neAv habits, 

Tliat these experienced operators could so effectively cut down in the 
number of wheels broken and improve in both wheel and production 
performance at this stage of experience indicates that learning of a better 
cutting cycle by old, experienced operators took place with the installa¬ 
tion of the program for training new operators. The improvement made 
by the exi)Oi'ieuccd operators as well as the trainees seems to justify 
movement analysis ns an effective industrial training method. 

Summary and Conclusions 

The problem of training rapidly a number of new workers to operate 
certain type of cutoff machines used for cutting tungsten rods into small 
discs for electrical apparatus has been (scplained, A method has been 
described which analyzes the foot movement of the operator by the 
recording of a pattern on a moving paper tape. A standard pattern was 
established and the recorder was used to taJse recordings of the trainees 
at frequent intervals. Thase recordings were explained on the basis of 
the standard. Various defects in the product were identified with the 
foot movement i)attcrns and many individual differences in both old and 
new operators were noted and described as clinical case studies. Finally, 
complete production records of all operator were kept. These records 
were plotted in graphical form to show the progress of the various groups 
at different stages of training. 

In gonei'al, the findings warrant the following conclusions: 

1. The disc cutting operation was analyzed by activity and the be.st 
form of cutting movement identified. 



Lavirenee G. lAiiduhl 


2. The cutting movement of the operators was shown in graphic 
form, compared with a standard, and need aa an effective training method. 

3. Training time was effi^tively reduced. At 8 weeks the produc¬ 
tion performance percentage of the trainees was better than that of old 
operatora who had had the same average amount of experience by the 
"pick-up” method, 

4. Trainees, who were taught to use the cutting wheel by studying 
the movement analysis recordings, secured better wheel performance than 
old operators. 

5. Trainees reduced their wheel breakage in a few weeks to a point 
much lower than the average of old operators at start of training program. 

6. Trainees did better in wheel performance than beginners who 
learned by the "pick-up” method. 

7. Experienced operators benefited by the training program. 

8. It is entirely possible that equally successful improvements in 
training could be made in numerous other manipulative jobs by the 
application of a similar method of recording graphically the performance 
of the operator. 

RecmdNomb&l, t9U. 
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Military Job Evaluation: Army Air Forces * 

Arthur 0, England,** CaptQin, Air Corps 

During tlio early stages of 1942 and 1943, when the reception centers 
were hulging with incoming men, the paramount problems facing the 
classification and personnel officera wore the initial classifying of these 
men, fulfilling tlic technical school quotas and inaugurating on-the-job 
training necessary to build efficiently operating tactical units. Little or 
no information was available on the subject of effective utilization of 
manpower. Job evaluation, by any method, was non-existent—or if 
existent, at least it was not available for general consumption by military 
personnel. 

A War Department Memorandum ^ issued in January 1943 stated in 
part that many enlisted men in the Army Air Forces who have been 
trained aa technicians in the various Army Air Forces Technical Schools, 
were being employed on jobs which did not require special training or 
special (lualificationa and which were appropriate for unskilled privates 
only. The Inspector General’s Department assumed some of the re¬ 
sponsibility for detecting and reporting to the War Department personnel 
misplacement and attendant wastage. Further, every Air Force or 
Command o,9tabJiflhed a fipecial unit known ns Classiheation Audit Teoms; 
who.se function it is to inspect periodically each installation in that Com¬ 
mand for proper classifiGation, assignment and personnel utilization, 
These teams are composed of officera who possess extensive experience in 
Military Classification and Assignment. 

In an effort to control the reclassification ^ of these highly trained 
technicians, Headquarters, Army Air Forces, issued a Memorandum ® 

* This Itcaenrcli Project was conducted during 1943 under the general supervision of 
Cot Alvin L. PHchnrd, Asst. Chief of Staff, A-1, Army Air Forces Eastern Flying 
Training Command, 

** Capt. Arthur 0. England is Officer in charge of Classification Research Section, 
Army Air Forces Eastern Flying Training Command. 

‘ War Department Mcmornndmn No. W016-9-43, Adjutant General's Department, 
January 22, 1043. 

* Reclassification is a term used to describe any change in the classificatior of the 

incumbent. Ittnay be downward (representing less utilization of the individuals capa¬ 
bilities), upward (representing greater uUlization of the individual's capabilities) or 
lateral (representing less ulilizalion of the individual's capabilities, but in a different 
field of skill). Insofar ns we are concerned iu tliis article, reclassilioalion will be con¬ 
strued to mean downward rcclnasification. 

* Army Air Forces Memorandum No. 35-18, January 22,1943. 

437 



438 


Arthur O. England 


malcing all reclassification subject to approval of n specially appointed 
Board of Officers (one of whom must be a Classification and Assignment 
Officer), at every Air Forces Air Field or similiar installation. Evidence 
must be established during the board meetings to the effect that the 
proposed reclassification of an incumbent will be of benefit to the Army 
Air Forces. Such reasons as: physically incapable of performing duties 
of the old job, proved inefficiency by actual on-Lhe-job trial, or the in¬ 
cumbent's qualificationa arc needed to perform in a more critically 
needed job specialty, would justify reclassification. 

Although this established control medium 1ms, to a large extent, pre¬ 
vented wholesale malassignmenl and inefficient personnel utilization, the 
evaluation of each individual case appearing before the Glassification 
Board was dependent ultimately upon the local, subjective interpreta¬ 
tions of the values of the military jobs by the Board. 

Job specifications of Military Occupational Specialties arc, by neces¬ 
sity, designed for flexible interpretations to provide a method whereby 
an individual, performing duties on various types of equipment, peculiar to 
each Air Force or Command, can qualify as a specialist in this one general 
job. For example, there ia one set of job specifications for Airplane 
Mechanic, However, the Airplane Mechanic who has been trained on a 
four-engine Flying Fortress is definitely a higher skilled mechanic and 
can perform a greater variety of mechanical duties than can a mechanic 
who has been trained on a single engine Primary Trainer Airplane, 
Both, however, receive the same rating of Airplane Engine Mechanic. 

It was because of the above instances of a lack of any standardized 
method of evaluating Army jobs, along witli the relatively high degree of 
subjective interpretations that has been entering into the problem of re¬ 
classification and personnel utilization, that the publication “Job Evalu¬ 
ation for Army Military Occupational Specialties," ^ appeared December 
18, 1943. The problem at hand was to provide a means of establishing 
standardized values for diffei-ent Army jobs for the purpose of ascertaining 
efficient utilization of available manpower.® 

Procedure: A Factor Analysis 

An attempt was made to identify all of the possible factors for a job 
analysis. Nine significant items were finally selected and retained in the 
rating scale, Each item is divided into six component parts, with a nu¬ 
merical value assigned to each. The numerical value of each item de- 

* Job Evaluation for Army Military OcoupaUonnl Specialties, developed by Capt. 
A. O. England, IleadquarloTa, AAF EdbIotii Flying Training Command, Classification 
Research Section, Maxwell Field, Alabama, 

“ It should be noted here that tlie puUication of "Job Evaluation for Army Military 
Occupational Specialties" was intended to serve solely as a "guide" and does not repre¬ 
sent an official publication by the War Bepartment. 
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ponds upon its relative position in the table (Table 1), i.c„ the level of 
difflculty-j or the higher the requirements, the higher the point value 
assigned to each item. The point value range extends from 0 points to 
a maximum of 5 points. This range Avas arbitrarily agreed upon. It 
could have been 0 to 50, or 10 to 100, or any progression of numlmr.s, 

In the selection of differentiating items, one very significant item had 
to be discarded, namely wage scale. Unlike most civilian rating scale.s, 
pertaining to the job, wliich are uaually weighted heavily, the Army docs 
not adhere-to any specific wage scale for military job.s, That is to say, 
a soldier’s grade (Private, Sergeant, etc.) does not necessarily prohibit 
him from performing any military job. Because of a multitude of factors 
influencing the promotion of enlisted men, it has been impossible to cor¬ 
relate any job to a particular grade. There are numerous instances of 
Sergeants working for Corporals because the Corporals arc more quali¬ 
fied by reason of proven experience on certain type aircraft than other 
soldiers of higher grade. 

Items to be Rated 

a. Educational RoquiremeiU: The range extends from none to Post 
Graduate, Even though exact information on educdtlcmal requirementa 
is obscure for any military specialty, the majority of siiccialtics have 
some minimum requirement, cither clearly cjitablwhcd in AAF Regula¬ 
tion 50-12 or arrived at by a consensus among those individuals exercising 
supervisory jui'isdiction, oven the pai-liculai' militory specialties. Point 
values assigned to the educational levels are indicated in Table 1. 

h. Civilian Ex-pmence: There are a few selected jobs in the Army that 
require civilian experience of varying degrees. Factors influencing the 
awarding of point values to this item are the existence or absence of 
similar training in the Army. Tabulating machine operators, office 
machine servicemen, and psychological assistants arc example.s of military 
specialties that require a civilian background in that specialty before as¬ 
signment to the specialty is made. Point values are assigned according 
to the time spent gaining experience in that specialty in civilian life. 

c. Training Time on Ike Joh: A conBen.sua among competent personnel 
was used to assign point values for the “average" time spent becoming 
skilled in the specialty. 

d. Intellectual Requiremeid,—By Minirnmn AGCT Score: ® Once 
again, in those instances whei-e the AGCT Score requirements are not 
clearly prescribed by regulations, such as the AGCT requirements for 
attendance at Technical Schools, a consensus among competent personnel 
was obtained, Point values assigned to this item are broken down ac¬ 
cording to the five groupings of AGCT Scores. 

* AGCT; Army Gonorfll Closaificfttion Teal. 



441 


Military Job Evaluation: Army Air Forces 

e. Skill: This represents a combination of aptitude and acquired 
talent. Perhaps this ia one of the weaker items in this factor analysis 
because of the difficulty involved in rating the "skill” employed in each 
military specialty. A point of iaaue may very justly be taken on the line 
of demarcation between "paasable” and "fair” skill. The extremities of 
this range are relatively clear; ICitchen Police, requiring "no” skill, and 
IBM Machine Repairman, requiring “superior” skill, are cited as ex¬ 
amples of the extremes of the point value range. It was only after con¬ 
stant comparison of all factors involved in the performance of each job 
that the ensuing ratings in the item were arrived at. 

/. Supervisory Capacity, — Number of Men Supervised: The point 
values assigned to this item are not dependent upon the number of men 
one has jurisdiction over, but rather the number of men one directly 
supervises and is responsible for in the exact performance of his job. 

g. Nature of Work: The range of this item is from "routine” to "su¬ 
perior employment of ingenuity.” Here, creativeness, originality and 
independent responsibility are evaluated. 

h. Equipment Used on the Job: No particular difficulty was encoun¬ 
tered in placing the proper point values to the breakdown of the scale in 
this item. The range extends from none to very intricate. 

The difficulty of all rating scales lies in the proportionate point value 
assigned to each component part of each item. Which items shall be 
weighted the most, which the least, will depend upon a general consensus 
among those people who are cognizant of the job requirements being 
considered. That does not necessarily represent an inherent weakness in 
Rating Scale theory, but rather a weakness in our knowledge of the re¬ 
quirements of Army jobs. 

Factor Analysis of Military Specialties Authorized 
for Use in the Army Air Forces 

In this section, a factor analysis of Military Occupational Specialties 
has been performed by items on the basis of Family Groupings of jobs. 
The total points awarded each Military Specialty have been rated by the 
rank difference method. The relative rated position each specialty holds 
to each other is indicated in the column entitled "Final Rated Positions.” 
The jobs have been arranged in a series, with the range extending from 
the highest evaluated job to the lowest evaluated job. 

Not only ia the "Final Rated Position” important in the evaluation of 
a job, but also the actual total point difference between the evaluated 
jobs should be given consideration. This becomes afc once apparent 
when comparisons are made among Military Specialties on Single, Twin 
and Four Engine Airplanes, and when interchange of jobs among different 
Family Groups is attempted. 
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511 Armorer 

683 Bombsight Mecbauic 

901 Munitions Worker 

678 Power Turret and Gunsight 

Mechanic 
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In this article, only five Militm-y Job Groups have ])eGn presented, 
Actually, all the existing pertinent Army Air Force jobs have been evalu¬ 
ated in their respective Family Groups. In addition to the distinct 
Family groupings of jobs, one otlier Group, known as the “Miscellaneous 
Group,” was brought into play. This Group rcjn'csonts u heterogeneous 
grouping of military jobs. Actually, many difterent family groups are 
represented and because they arc, it was inipo.s.sibIe to difTerentiato them 
by the factor analysis method. Examples of jobs falling into this 
grouping are Bricklayer, Ifaundry Technician, Translator, Bandsman, 
Dog Trainer, etc. Interchange of duties within this miscellaneous 
group will be dependent upon tlie discretion of the Classification Board 
after a careful study has been accomplislied on the proposed transfer. 

Index for Evaluated Military Occupational Specialties 

The evaluated jobs were prepared in a readily accessible list. This 
listing, by family groups, shows the different jobs by their degree of 
“over-all” difficulty. Reference may be made to the index of evaluated 
jobs under the following circumstances: 

(1) To ascertain if one job is upgraded or downgraded relative to 
another in the same family group. 

(2) To ascertain the ccurectnesa, from a classification standpoint, of 
proposed new duty assignments in relation to the present duty assign¬ 
ment. 

(3) To ascertain the validity of reclassifying an enlisted man from one 
Military Occupational Specialty to another. 

(4) To reallocate enlisted men efficiently within a Command. 

The interchange of jobs from one family group to another has always 
presented a challenging problem to the Ciaasification and Assignment 
Officers, However, until such time as an evaluating scale has been de¬ 
vised whereby family grouping jobs may be compared, it appears highly 
improbable that a valid comparison can be made between the total 
awarded points of a specialty in one family group to the total awarded 
points of a specialty in another family group. A specialty requiring a 
high degree of mechanical skill, thus being rated highly in the evaluated 
job scale, cannot be compared adequately, say to a particular clerical 
job requiring a high degree of creativenesa. 

Preparation of a llcallocation Adjustment Table 

An attempt has been made to prepare a reallocation adjustment table 
to be used as a guide in the reallocation of enlisted men by the qualificii- 
tions in a particular Military Occupational Specialty, between single, 
twin and four engine flying schools. 

The Personnel Divisions of any Air Force headquarters have from 
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Table 3 

Index for Evaluated Military Occupatbnfll Specialties; Final Listing of Rated 
Jobs by Level of their DifTiculty 


SSN 

Job TiUe 

Total 

Points 

Final Rate 
Position 

274 

Adminiatrativo and Clerical Grouf 
Public Rclaltona Specialist 

1 

25 

1 

502 

Administrative Specialist 

22 

2 

275 

Olnsaification Specialist 

10 

3.5 

623 

Financial TypisUClcrk 

10 

3.5 

213 

Stenographer 

16 

5 

405 

Clork-Typiat 

15 

6 

82Q 

AAF Supply Technician 

14 

7 

821 

QM Supply Technician 

13 

8 

056 

Clerk, Non-Typist 

11 

9 

348 

Parts Clerk, Automotive . 

10 

10 

836 

Supply Clerk 

g 

11 

667 

Message Center Clerk 

8 

12 

056 

Postal Clerk 

7 

13 

663 

Armament and Ordnance Group 
Bombsight Mechanic 

29 

1 

078 

Power Turret and Gunsight Mcchonic 

28 

2 

612 

Airplane Armorer-Gunner 

19 

3 

911 

Airplane Armorer 

17 

4 

611 

Armorer 

12 

6 

001 

Munitions Worker 

6 

6 

870 

Chemical Group 
Chemical Technician 

27 

1 

800 

Decontamination Equipment Operator 

17 

2 

785 

Toxio Goa Handler 

13 

3 

760 

Airplane Maintenance Group 
Airplane Maintenance Technician 

32 

1 

748 

Airplane Mechanic-Gunner 

23 

2 

085 

Airplane Electrical Mechanic 

21 

3.5 

680 

Airplane Instrument Mechanic 

21 

3.6 

684 

Airplane Power Plant Mechanic 

20 

6 

087 

Airplane Propeller Mechonio 

10 

6.5 

114 

Machinist 

19 

6.6 

605 

Fuel Cell Repairman 

18 

8 

628 

Airplane Hydraulic Mechanic 

17 

0 

747 

Airplane and Engine Mechanic 

16 

10 

556 

Airplane Sheet Metal Worker 

14 

11.6 

669 

Glider Mecbonic 

14 

11,5 

650 

Airplane Woodworker 

12 

13 

548 

Fabric and Dope Mechanic 

10 

H 

089 

Airplane Cable Mechanic 

8 

16.5 

256 

Welder, Combination 

8 

15.6 

014 

Transportation Group 

Auto Equipment Mechanic 

13 

3 

932 

Special Vcliiclo Operator 

8 

2 

931 

Heavy Auto Equipment Operator 

7 

3 

346 

Auto Equipmont Operator 

6 

4 
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time to time experienced di/ficulty in the reaHocation of liighly trained 
military apecialists, espccia.Uy when this reallocation necessitated the 
involvement of pereonnel at single, twin nnd four engine (lying schools, 
It has been far too great a task to expect IlendciuartcrH Assignment 
Officers to analyze each enlisted man’s Qualifications to ascertain the 
type of equipment on which the individual has had training, thus earning 
a skilled or semi-skilled rating in a Military Occupational Specialty. 

Such problems ns "can an Airplane Maintenance Tcclinician, experi¬ 
enced only on single engine, Basic Training planes, be adecpiatoly em¬ 
ployed as an Airplane Maintenance Technician on four engine Flying 
Fortresses" are confronted daily by Personnel sections, Yet, objective 
answers to such problems are not to be found in existing Army directives. 
Further, the Engineering Officers at different airfields have been faced 
also with this perplexing problem, namely, that enlisted men qualified as 
Airplane Maintenance Technicians on Basic Training planes, were as¬ 
signed to them for work os Airplane Maintenance Techniciana, yet the 
airfield only has four engine planes stationed there. In. the interest of 
good military classification, these enlisted men liave earned their clas,fifica- 
tion as Airplane Maintenance Technicians nnd should not be deprived of 
it. Yet in the interest of efficient engineering oporatioas, tlie men are not 
qualified to perform the duties of a Maintenance Technician on, let’,s say, 
Liberator Bombers, B-24 planes. Personnel shortages at different airfields 
are rated only by the general Military Occupational Specialties without 
any specific reference to the typo of equipment or airplane on which the 
men have had experience. Furthei', personnel are reallocated from airfield 
to airfield simply by mass numbers, disregarding, because of necessity, 
experience levels or types of experience of the Individual man involved. 

In order to overcome some of the personnel reallocation problems out¬ 
lined above, it was decided that a comparison of indices for evaluated 
military specialties relative to single, twin and four engine airplanes be 
conducted. To compare adequately the total evaluated points a.saigned 
to each military specialty at single, twin and four engine flying schools, a 
job analysis was conducted, at representative stations of each of the 
aforementioned flying schools. Only tho.se Airplane Maintenance Mili¬ 
tary Specialties performed at all three typas of flying schools wore sub¬ 
jected to the factor analysis breakdown. Comparative figures among 
the different types of single engine planes, as well as among the twin and 
four engine planes, proved to be insignificant. Therefore, the realloca¬ 
tion adjustment table (Table 4) has only three main groupings—single, 
twin and four engine. 

Reasignment of surplus specialists or the reassignment of malaggigned 
specialists, for corrective measui’ea, between different types of flyiog 
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schoola may be made efficiently if the relative evaluated job ratings at the 
different type of achoola are made accessible to those in control of reas- 
aignmenl. For example, should an Birpiane Crew Chief on a Basic 
Training aircraft be sent to a four engine flying school if no vacancies 

Table 4 


Eeallocatdon Adjustment Tabic 



Single Engine 


Twin Engine 

Four Engine 



Suffix r 


Suffix II 

Suffix IV 


SSN 

Job Title 


Job Title 

SSN Job Title 

Points 





750 AP Maint. Tech. 

32 



750 

AP Maint, Tech. 


31 






32 






29 






2B 

760 

AP Maint. Tech. 




27 






26 






26 






24 






23 






22 



086 

AF Eleo. Meoh. 

686 AP Inst, Mcch. 

21 





686 AP Elec. Mech, 

21 



685 

AP Inst. Mech. 


20 

686 

AP Inst. Mech. 

687 

AP Prop. Mech. 

087 AP Prop. Mech. 

ID 

687 

AP Prop. Mech, 




18 

085 

AP Elec. Mech, 




IS 



628 

AP Hydraulic Mcch. 

628 AP Hydraulic Mech, 

17 

628 

AP Hydruulio Mech. 



747 AF and Eng. Mech, 

16 



747 

AP and Eng. Mech. 


16 

747 

AP and Eng. Mech. 

565 

AP Sheet Metal 

AP Sheet Metal 

14 




Wkr. 

Wkr. 


666 

AP Sheet Metal 




14 








exist at any other single engine schools? Reforence to the Reallocation 
Adjustment Table presents the following picture: 

a. Airplane Maint. Technician at a Single Engine School has been 
awarded 27 rated points- 

b. Airplane Maint. Technician at a Four Engine School has been 
awarded 32 rated points. 

From the standpoint of effective placement of personneli a plus or 
minus (±) two (2) evaluated points is considered a reasonable difference 
to overcome, without losing too much training time, in the adjustment of 
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a specialist to a diltorcnt type of job training. The ndjuatnicnt ijroblem 
involved lierc become.s, at once, apparent. This Airplane Maintenance 
Mechanic on the Single Engine piano would find it almost impossible to 
overcome the five (5) points dilXci*euce were he to be placed on duty as an 
Airplane Maintenance Technician on a Four Engine j)lane. Tliirs, if he 
were transforred to a Four Engine Flying School, ho would have to start 
in the lower category job, Airplane and Engine Mechanic (747). 

Thus, it is apparent that reference must be made to the tyj)C of cciuip- 
menl upon which the enlisted man has won his rating ns a Military 
Specialist and how the point value of that flpecinlLy at cacli type of Flying 
School compares before correct and cfRcicnt veallocation of military 
specialists can be effected. 

Summary 

In summarizing, the salient fcatui'ca of this job study have been: 

1. The preparation of a standardized method to interpret the relative 
level of difiiculty of different military jobs. 

2. The preparation of point rating scale, with assigned values to each 
job, which is based upon nine significant job features, This helps reduce 
the subjective interpretation placed upon broad, generalized job specifica¬ 
tions contained in the army publications, 

3. The preparation of a reallocation table, aj^plying the principles of 
factor analysis, to assist those military pciaoniicl people in the task of 
reallocating their overages and shortages of personnel most efficiently. 

4. AUhongh this job study was only utilized extensively in the Army 
Air Forces Eastern Flying Training Command, Hcadquartcra, Army Air 
Forces, requested that distribution of "Job Evaluation for Army Military 
Occupational Specialtie,9’' be made for all Air Forces and Commands 
within the continental limits of the United States for their inspection and 
criticism. Reports received from these other Air Forces and Commands 
were most favorable and the general validity of the devised rating scale 
was not challenged. 

5. The problem of military job classification, evaluation and personnel 
utilization is constantly assuming added significance. Perhaps some of 
the ideas set forth in this presentation will in some suuill way shed addi¬ 
tional light upon these intricate problems. 

Received Oclober 17, 19^. 



Aircraft RGCognition: II. A Study of Prognostic Tests 
lester Luboisky 

Universily 

The present article reports an attempt to determine characteristics of 
the individual which influence his final level of performance in short-ex¬ 
posure aircraft recognition training. It was hoped that the approach 
followed would permit (a) the construction of a prognostic test battery, 
and (6) an analysis of the concomitants of the final level of performance- 
Because of the dearth of knowledge on this subject, the selection of 
factors to be studied was necessarily dictated by personal opinion as to 
the factors most likely to be involved, the possibilities of rapid measure¬ 
ment, and certain related aspects of importance in the life situation to¬ 
wards which the Navy recognition training program was directed. An 
instance of the last is speed of recognition. 

The data in this paper were obtained during a previously reported 
experiment (2) in which 4 equated groups, totaling 30 subjects, were 
taught aircraft recognition in a standardized manner. The subjects 
were pre-aviation V-5 students at Duke University. 

Before training, a battery of "pre-testa" was administered which was 
intended to (a) measure possible perceptual and learning factors associ¬ 
ated with "aircraft recognition ability” and (6) aid in equating the groups. 
After training, an extensive battray of “post-tests” was administered to 
facilitate analysis of the final level of performance. It is the scores of all 
subjects on these pre- and post-tests and on the Final Test of aircraft 
recognition which comprise the main data of this paper. 

In accomplishing the first aim, the selection of tests which have 
predictive value for the outcome of training, the procedure essentially 
was to correlate scores of all 30 subjects on the pre-testa with scores on 
the criterion test, iii this case, the Final Test. The testa which correlated 
significantly were treated by the Doolittle technique to obtain the multi¬ 
ple correlation with the Final Test and the percentage of the variance 
accounted for by each test. A further subsidiary aim was to obtain at 
least suggestive evidence as to the concomitants of the final level of per¬ 
formance in aircraft recognition. This was based upon the intercorrela- 

* Part of a thesis submitted in partial fulfiUmcot of the requiremeats for the degree 
of Doctor of Philosophy in tho Graduate School of Arte und Sciences of Duke XJnivor- 
aity, 1945. 
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tions of all tests, pre- and post-, and the necessarily .siil)jective estimate 
of what each test tests. Because of the relatively ai^pavcnt meaning of 
some of the tests, such ns A. C. E. Psychological lOxamination and the 
Test of Previous Knowledge, and the large number of te.st intcrcorrela- 
tiona, the tash of interpretation was considerably facilitated. 

Procedure 

Glasses were held for 45 minutes (m MoiKliiy, Woclno.Kday and Friday 
for ft 6 week period. The pre-tcsf.s Ji.sted in 'I'ablo 1 u’ore adniiui.stered 

Table 1 

Corrclaiiona of nil Data with llic Critcrnin 
Pie 1, Pre 2, and Post Hefer to tho Time of Adminislralion 


Span of Apprehension* 


Interest I 

.53 

Pro 1 

.13 

Intcrcsl II (Im])rovt(inout) 

.47 

Pro 2 

.05 

Previous Knoivlcdgc of Planea 


Post 

.01 

Pro 1 

.41 

Improvement Pro 1—Post 

-.13 

IleacUon Time 


Improvement Pro 2—Post 

.05 

Ughl 


ilfemory Location 


Pro 1 

,02 

Pro 1 

.11 

Post 

.03 

Pro 2 

.10 

Common Objecl.^ 


Post 

.18 

Pro 1 

.18 

mory-CompUt Figures, Pari 1 


Post 

.41 

Pre 1 

.38 

Improvement Pro 1—Post 

-.06 

lifmory-Comples Figures, Part B 


Recognition of Plancfl 


Pro 1 

.20 

Post 

.26 

Jl/einorj/-ArrpIaTie kecofliirtion Aspects 


A.C.E. Pji/cJifilopicnl h’lmntnQtioiv 

.16 

Pro 1 

.29 

Grades in Academic IPorA; 

.14 

Post 

.20 

Study Tine on A ircraft iiccogr\ilion 


Memory-Complex A'pin'cs, 6" 


3rd \Feek 

-.57 

Pie 1 

.03 

Study Tine on A ircrdfl Recognition 


Acuity 


//Ih Week 

-.43 

Pro 1 

.03 



Post 

.30 



Improvement Pro 1—Post 

.54 




* Conelfttion coefTicients Bflcr scoring by tm nllcrnativc muilicxl (ninL. ±) are: 
Pro 1 = .10; Pre 2 = ,19, nnd Post = .06. The cons'inkent Inch ol conelnLion is impor- 
laiit because this test Ims been used in nonic rccogiutioii schools boforc! Lniiiiing on the 
assumption that it improved airmift recognition ability. 

on two successive evenings 3 days before the training period began, The 
“Pre 1“ tests were given on the first evening luid the “Pro 2“ tests, which 
were alternate forms of Pre 1 tests, were given on the second evening, 
The post-tests were on the Monday and Wednesday classes of the last 
week. These tests also were alternate forme with the exception of 
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Acuity and Recognition Time for Planes. In addition to the above, A. 
G. E. Psychological Examination scores and Grades in Academic Work 
were obtained from the Dean's office and Aircraft Recognition Study 
Time was obtained from a questionnaire on study habits. 

The experimenter operated a Baloptican with a shutter attachment 
for obtaining 1/50" to 1" exposures (by calibration, 1/40" and 4/5" 
respectively). The stimulus figures were projected on a screen about 5 
feet from the subjects. The testing was done in groups no larger than 
8 to lessen the possibility of differences between subjects caused by 
seating position.^ The less essential details of the apparatus and testing 
conditions are more fully described-in another article (2). 

Description of Tests ® 

1. Sfan of Afprehension (Pre /, Pre 2, Poal). The subjects were reciuircrl 
to estimate the number of 5 centimeter ® randomly arranged horizontal lines 
flashed on the screen for 1/50". The projection area of the screen was approxi¬ 
mately 15'' X IS". Each teat contained 10 exposures with 4, 6, 8, or 10 lines 
in each. The scoring was done in two ways: (o) the number of incorrect 
egtimates, and (b) tlie sum of the deviations from the actual number of lines 
exposed. 

2. Mmory-Locaiion [Pn 1, Pre 2, Post). A test of ability to reproduce on 
n grid sheet the location, of a group of X 5" rectangles flashed on the 
screen for 1/50". Each test contained 12 exposures of 5, 6, or 7 rectangles 
each. The score for each grid was the total of the omitted end incorrectly 
fillcd-in grid spaces. 

3. Memory-Complex Figures, Part 1, 1160" (Pre 1). Subjects must repro¬ 
duce simple geometric line figures presented for 1/50". Only 1 exposure was 
given for each of the 4 figures constituting the test. An arbitrarily-devised 
scoring system credited one point for each of 4 aspects of each figure. 

4. Memory-Complex Figures, Part S, IfdO" (Pre 1). Subjects must repro¬ 
duce geometric line figures of greater complexity than in Part 1, presented for 
1/60", Each of 3 figures was given 4 times in succession and after each presen¬ 
tation the earlier reproductions were covered with the left hand wliile the now 
reproduction was drawn. The scoring was 1 point for each of 0 arbitrarily 
chosen aspects of each figure. The points for each reproduction were totaled 
to yield a score for each figure. 

5. Memory-Airplane Recognition Aspects, IfBO" (Pre 1, Post). Finn view 
diagrams of airplanes, taken from Aeronautics Aircraft Spotters’ Handbook (1) 
were presented for 1/50", Sixty-five seconds were allowed after each exposure 
of a plane to checlc tlie presence or absence of 14 recognition aspects on a 
mimeographed check list. Subjects were informed that these were planes 
which were infrequently used and hence unfamiliar to them (as, e.g., Loire- 
Oliver 45, Falclio, Mornne-Saunier 406). Before starting the test every effort 
was made to be sure that the recognition aspects in the clieck list wore com¬ 
pletely understood. To equalize the amount of guessing, subjects were directed 

* Annlysia showed no differences due to seating position. Staff, Rgycliological Test 
Tilm Unit (3), mention like conclusions. 

* Fuller dcaci'iptlons atul dfuslralions of the test materials arc presented in the doe- 
tornl dissertation available through the Duke University Library. 

® Five centimeters after projection on the screen. Tire increase in size on projection 
is 1 to 6, 
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to leavfl no omisaiona. The Pro 1 test contained 10 planea, and Post test 
contained 6 additional planes. 

C, Memorij-Com-phx Fiqnfcs, B" {Pre I, Pre B). This test is similar to the 
Memory for Designs test in tiie Stniiford-Uiiict. The 2 cards in Pro 1 wero 
almost idontical the test entda in Vorm I. and M of the Stanford-Binot. 
Each test card coiitninod 2 figures which were presented Himultancously for 5". 
After approximately 3 seconds subjects were reminded to look at \)()th figures. 
The figures on the Pro 2 cards ^ were considcnildy more complex tlmn tliosc of 
Pre 1. A more refined scoring tlmn that used by tlio Stanford-Binot was 
devised—1 point for each ot 5 aspects of the first figure imd I point for each 
of 3 aspects in tlie second figure of cacA card, 

7. Aciitfy (Pre 1, Post). This lent employed the Snellen Symbol E Charb.^ 
The subject indicated the direction of the open end of the E using tvvo-cyed 
vision. The acorc was the number of E'a correctly read, on a chart with 
38 letters. 

8. Interest I, and 9. Interest II. These to-sts wore given at tlio end of the 
fourth week of training. By way of introduction, tlic expcrimentcT stated 
that some planes would be described wliich would not be included in the course. 
However, sfcudoiita might ho interested in these planes since they were com¬ 
monly used in training aviation personnel and in passenger service. A test 
was given of 6 planca, 3 views for each, to see liow many were already known 
before toaching. This tost will bo roferred to as Interest I. The names, 
recognition features, and interest items for each plane wero then discussed 
while viowing each plane for approximately 2 miiuiles each. Immediately 
oftcr this teaching and without any previous warning anotlicr test was given 
to SCO how much had been learned. The Interest 11 scores are the improve¬ 
ment from the first to the second test. The scores on both the Interest I test 
and the Interest II teat are considered as interest mcaHurcs—the former on the ■ 
assumption that Iho.so students Interested in aviation would have known more 
of the common planes, and the latter on tho ns-sumption that thoso students 
with greater interest would bo more receptive to tho teaching. 

10, PmiQus /Cfioiii/cdgc of Planes {Pu I). This teat contained 33 of the 30 
planes to bo included in the syllabus, given a 3" exposure for each. All were 
plan view diagrams. 

11. Reaction Time. Before and after training^ reaction times were taken 
for (o) seeing a 1/50" light flash on the projection ecrcon, and (6) narning 
common objects, such as umbrella, book, cat, etc., flashed on the projection 
screen, for 1/60". These two kinds of reaction time were expected to prove 
useful when tho rccoguition time Cor planes, measured at tho ond of training, 
was to be interpreted. Tho subjects were required to lift their forefinger from 
a stimulus key in circuit with a standard timer to indicate recognition and 
then name the plane.® 

12. Americon Council on Education (A.C.E.) Pa]/chological Examination. 
Scores on. this test (total score on linguistic and quantitative Bcctions) wore 
obtained from the Dean's office. Most of the tests had been administered 
duiing the previous Beraester. 

13, Grades in vlcaalemic Work. Tho Dean’s oflice also supplied tho pre¬ 
vious seihestcr's grades in academic work. Scores are tho average of point 
equivalents for eacli grade; 13 points for a grade of A, 10 for B, 7 for C, etc. 

< It was found that this set of Btimuliui cards correlated highly with Pro 1 but with 
no other test. Tho greater complexity of these figuroa probably introduced an addi¬ 
tional influence to that menaured in Pro 1. 

* American Optical Co., No. l(W2. 

• The writer ia indebted to Mr. Walter Kiiight of the Departmeat of Physics, Duke 
University, for constructing tho efficient reaction tiinc shutter attachment. 
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14. Study Tinie on Aircraft liecogniiion, 3rd Week. 

15. Study Tithe on Aircraft Recognition, J^th Week. The time spent in 
studying aircraft recognition outside of class was recorded on a questionnaire 
on study habits. Tlie total time in minutes for eacli week was used for corre¬ 
lation purposes. 


The Criterion Measure: the Final Test 

All testa were correlated with the 1/50" Final Test which was admini¬ 
stered at tlie cightccntli session, the last session of the course, In the 
last 2 weeks of this course all groups were trained at the 1/50" standard 
and given many views of each plane. One picture and one diagram view 
of all 30 planes tauglit gave a total of 72 exposures in the 1/50" Final 
Test. This test was longer and more difficult than any previously given. 
The split-half rcliability coefficient wag -{-.77. 

Results and Discussion 

Tests vjtlh Significant Correlations with the Pinal Test and with Each 
Other. The correlation coefficients of all testa with the criterion are 
presented in Table 1. Table 2 presents only those pre-tests with signifi- 


Table 2 

Main Tests: Correlalioii with Criterion, HcliabiliLy, and Significant 
Correlations with Other Tests 



r with 
Final 
Test 

Reliability: 

Self-r 

or 

Test-retesfc 

Significant r's with Other Teats 

1. Memory-ComplexFigurcs, 

.38 

Pertn 


Memory-ComplexFigiircs, 

.30 

Part 1. 1/60” 


Part 2 J 


6” 


2. Memory-Complex Figures, 

.03 

Pre 11 


Memory-Location, Pro 2 

,54 

6” 


Pre2J 


A.C.E. Psychological ISx- 






amination 

,43 





Memory-Complex Figures, 






Part I 

.30 

3, Previous Knowledge of 

.41 


.74 

Interest I 

,43 

Planes used in the 






Syllabus 






4. Interest I 

.53 


.42 

Previous ICnowledga 

.43 

5, Interest II 

.47 


_• 

A.C.E. Psychological Ex- 






amination 

.64 


* No aatiafactory method is available for finding the reliability of this improvcnicnt 
score. However, an improvement score cannot be reliable if the tests from which it is 
calculated arc unreliable, The splitrlmir reliability of the test from which Interest II 
is derived are .42 and ,52 respectively. 
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cant ^ Goi'ielationa and also includes their rcliiibilUy cocITicienta and a 
list of other pie- and post-tests Avitli which these correlate significantly. 
The highest correlations with Llio criterion “ (Table 11) ai’c (1) Memory- 
Complex Figures, Part 1; (2) Mcniory-Com|)lcx Figure.s, .V'; (3) Previous 
Knowledge of Planes used in the Syllabus; (4) Interest I, Knowledge of 
Planes {trainora and passenger); (5) InteroKt U, Inpnovmnenl m Knowl¬ 
edge of Planes (the same planes as in Interest I). 'J’lio Higiiificant cor¬ 
relations of tlic-se "main" tests with other teats sliould give some hints na 
to ihe ntt-tuve of these uwuw tests o,u<l tit tlu*. same Uiue a Ueltev \iudev' 
standing of the nature of ‘'aircraft rccofiiiition ability,” This ])iol)lem 
will be more profitably considered after arriving at an estimate of the 
variance contributed by each main test to the total variance. 

DeveIoj)vienl of a Proynodic Ted BaUery. In the dcV(5loj)ment of a 
prognostic test battery, the intcrcorrelationa of 5 main tests and the 
Final Test were treated by tUe Doolittle tedini(|ue and a multi])Ic cor¬ 
relation (H) of .855 obtained. Tlic index of forecasting cflicicncy is 
48,2%. The standard error of estimate was found to be 4.09. This 
means that in 07% of cases the predicted criterion snoro will bo within 
4,09 points of tlio actual criterion score. The It lins a coofTiciont of 
nuiltijile determination of approximately 73% of the variance in the 
Final Test, Facli variable contributes tlio following amount to the 
total variance: Xs, Mcmory-Ccinplox Figures, PiirL I, J/fiO”, 8.0%; Xa, 
Memory-Complex Figures, 5”, 28.9%; X^, Previous ICnowledgo of Planes, 
9.fi%; Xe, Interest I, Knowledge of Planc.s, 13.0%; and Xo, Interest II, 
Improveinent in Knowledge of Pianos, 13.0%. Py far tho greatest con¬ 
tribution is made by Memory-Complex Figures, 5". Interest I had 
Interest II molce the next greatest contributions. However, all contri¬ 
butions are largo enough to make it dosiriiblc U) use all tests if this 
battery were to bo used prognostically. 

Beta weights were then computed and the following regression equ¬ 
ation for predicting the criterion scores from the 5 testa was found; 
XiP:,d.= -3.100 + 1.033 X 2 +1.815 Xa + 0.443 Xi + 0.57G Xs + 
0.117 Xo. 

It was suggested above that all of the testa should be uaed for prog¬ 
nosis since none of the variance contributions is small enough to di.sregard. 

^ All coTrclntifliia must be. .30 lo be signiCciinl at Oio 5% level luid ,40 lo be aignifi- 
ctinL at ll\Q 1% level. 

“ Since the lii(;liesL oblnincd correlation cocfllcicnt between cttriBiiculivo aircraft rec¬ 
ognition teals la only ,G‘l, a coTrection Sor utUtnualion woulil conHuleni.b'iy iiierensc all 
correlations. However, H was thought more desirable in this preliminary sLiuly to 
present all the eoelTicicTita exactly as obtained and merely note Llic fact that a correction 
for attenuation would liave the effect of increnaiDg all cociricicnta by 1/V.644 or c.g. if 
r = .3&, Tc = .48. 
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Use of all tests presents no administrative difficulties, since all testa 
would take less than 45 minutes.* However, after this battery is vali¬ 
dated on another new and larger group, it may be found that inclusion of 
some of the testa is not economical. Furthermore, it is likely thot length¬ 
ening of certain of the tests will result in an even greater R. The high R 
already obtained indicates that tho preliminary search for prognostic 
tests appears to have succeeded in aompling the major areas contributing 
to success in aircraft recognition training. 

Table 3 

Diagraninifltic Analysis of InterrolatioDshipa (Significane Correlations) Betiveen the 
Main Teeta;* Final Test and the Main Tests; and the 
MainiTests’and Other Testa 


Kind of Factor 

Main Testa 

(Correlated Significantly 
with Final Teat) 

Tests Correlated 
Signifioandy 
with Main Test 
but not with 
Final Test 

Memory 

Measured before Training: 
Memory-Complex Figurea, Part 1,1/50" 



Memory-Complex Figures, 5". 

, .Memory-Location 

Post Knowledge 

Frevioua ICnowIcdgc of Planes 

A.C.E, 

Interest 

Interest I 

Interest II... 

..A.C.E. 

Acuity Improv. 

Measured after Training: 

Improv. in Acaily 


Reaction Time 

Reaction Time: Clonunon Object 



(Post). 

, , .Reaction Time; 

Study 

Study Time for Aircraft 

Recognition of 
Planes (Post) 


llccQgrution** 



* Main tesla which nro significantly correlated are bracketed. 
** A negative correlation. 


Analysis of Conditions Influencing Performance. One aim of this 
experiment was to obtain at least suggestive evidence which would in¬ 
crease understanding of the concomitants of successful performance. 
The variance contribution of eacli pre-test to the total variance is pres¬ 
ented in the preceding section. In the present section a more complete 
analysis will be attempted. For this purpose all tests, rather than only 
the pre-tests, with significant correlations with the criterion, must be 

“ Adiniiiistralive time required for each teat: Xi = five minutes; Xj = five minutes; 
Xi =1 ten ininutoB; Xt = five minutes; and Xt = twenty rainiitea. Total administra¬ 
tion time = forty-five minutes. 
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considered. In addition, these tc.sts might h(5 better under.stood by 
considering the tests with whieli they, in turn, correlate .significantly, 
The diagrammatic analysis in Tabic 3 is based upon l)oth scL.s of correla- 
tiona. 

A hypothetical analysis of the concomitants of succc.s.sful performance 
based upon Tabic 3 might be a.s follows; 

(a) Memory for complex figm-es, jjorhaps of a visual iiieinory type. 
Both memory at 5" and 1/50" cxi)osurc arc involvccl hut particu¬ 
larly the former. 

{h) Past interest in learning plane,s and rc.sultant knowledge of .some 
planes. 

(c) Interest and intelligence which permita ready learning of 
planes. 

(d) A tendency to adapt to the visual conditions demanded by the 
mode of presentation of planes. This is an infcrencG from the 
significant correlation of Improvcmorit in Acuity and the Final 
Teat. 

(e) After training there ia ability to recognize and name common 
objects more quickly under sliort exposure pre.sentation condi¬ 
tions, 

(/) Exiatonce of the above make a great deal of studying unnocGsaary. 
Another possible inlerpiotatiou is that much atudy of the kind 
done actually intorfers with proper learning. 

It is possible to infer from the variance contributions previously 
determined that the first 3 concomitants listed above are important for 
Bucceaaful performance in the order listed. The factor which contributes 
the most to the final level of performance is the ability to remember com¬ 
plex material, relatively independently of exposure time. The past 
knowledge factor which contributes the second largest amount may also 
be considered a memory factor. 

Summary and Conclusions 

The data for the present report were obtained almost entirely from 
tests given before and after an aircraft recognition training course. A 
prognostic battery and regression equation were found I)y applying the 
Doolittle technique to pre-tests with significant conelntioua witli the 
Final Test. All of these solectod pre-tests were found to contribute 
sufficiently to the total variance to warrant inclusion in the jirognostic 
battery. Because of tho high multiple correlation of .85 and the ca.sc of 
administration of these tests, validation of the battery on a new and 
larger group of students is recommended. 

“Although the intelligence measure (A, C. E.) did not correlate aignificantly with 
the Final Test, it did correlate highly with Interest II, 
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On the basis of the eignificant correlations between individual teats 
and the criterion, a hypothetical analysis was attempted on the concomi¬ 
tants of achieving successful performance in recognition under conditiona 
of short exposure. These concomitants are briefly as follows: [a) memory 
for figures; (fa) previous knowledge of planes; (c) interest and ability in 
learning planes; (d) adapting to the short exposure visual conditions; 
(e) quick recognition of common objects ate short exposure training; and 
(/) comparatively less homo study. 

These relationships should hold particularly for recognition of this 
specific stimulus material. However, there is good reason for supposing 
that the relationships would hold for recognition of material of comparable 
level of complexity and of similarity within the group of items. 

Furthermore, the data presented in this section are of great utility 
for future experiments. The analysis of concomitants of achieving the 
final level of performance would enable a more complete equation of 
groups than was possible before this experiment, and would open the 
way to final answers to the kinds of problems described in an earlier 
experiment (2) on the relative efficiency of training procedures. 

Recmd Oclokr 18,19U- 
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The firmy encompasses a tremondou.H adininislniLive msponsihility, 
This is true both from the point of view of the nninher of individuals ad¬ 
ministered and from the many details of iiinnan boliavicu* minutely 
effected. Some militiwy psychologists have proven so siuicessful in their 
approaches to adiniiiistrative problems that their conimanclorH have 
placed them in larger administrative duties involving fascinating and 
practical psychological problcm.s. Most of the psychological j^robloms 
posed cannot be referred for final solutions to esUiblislicd laws, principles 
or axioms. An altornativo approach ia to obtain as much insight as 
passible through discussions by tho.se trained in fields of knowledge 
closely related to the problems. This i)ai)cr rcprcsculs ono such dis¬ 
cussion. It outlines tried mcthod.s of solutions to army administrativo 
problems and suggests the psychological principles from which they 
appear to derive. 

Administrative Organization 

One of the first problems containing iwychological implication-s with 
which the army administrator must concern himself is the typo of per¬ 
sonnel organization he is going to install in order to accompli.sh the mis¬ 
sion for which he is responsible. The size of the mission is often so great 
that the administrator cannot accomplisli the job l)y himself and cannot 
even keep himself infonned on all of its many aspects. It ia therefore 
incumbent on the administrator that he divide the mission into goals and 
assign the goals to sub-administrators. 

The division into goals should be based on a caicful .study of the 
mission. The mi.ssion requires execution of certain work functions in 
order to accomplish it. These work functions form clustcu’.s in the Hcnso 
that the component function.^ of any one cluster arc higlily flepeadcnb 
upon one another but arc relatively independent of liic functions of oihci' 
clugtors. The division of the inksion into goals should ho so iicc5oini)lishcd 
that each goal repregents a cluster of work function.s, An ilhi.stration of 

* On militaiy leave of nlwcnce from the Dqjartnicnt of PHyohology, University of 
Illinois. 
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this point is readily available in the consideration of personnel adminis¬ 
tration and classification responsibilities as a mission. One possible 
division would be to have a personnel administration section and a classi¬ 
fication section. Each section would handle its particular responsibilities 
as they pertained to both officers and enlisted men. An alternative 
division would be to have an officer section and an enlisted section. Each 
section would handle personnel administration and classification func¬ 
tions, one section as they pertain to officers and the other as they pertain 
to enlisted men. A comparative study of these two alternative divisions 
reveals that soldiers on duty in the officer section could operate satis¬ 
factorily with little reference to soldiers on duty in the enlisted section. 
The work functions represented by the officer and enlisted sections con¬ 
stitute clusters and the clusters are relatively independent. This condi¬ 
tion is just the opposite of that which exists when the division is into 
a personnel administration section and a classification section. The 
soldiers on duty in these two sections must be continually communicating 
with one another in order to function satisfactorily. These two sections 
do not represent independent clusters. 

The division of the mission into goals represented by relatively inde¬ 
pendent work clusters, as purposed herein, is considered to be desirable 
because of the following reasons: 

(1) It minimizes the amount of coordination needed; (2) It lessens 
the chances for personality frictions which are apt to occur when persons 
of equivalent rank and responsibilities have to coordinate and determine 
for which aspect of a mission they are responsible; and (3) Each sub¬ 
administrator has the maximum amount of autonomy possible within 
army organization, Practically all his dealings are with his immediate 
superior or his immediate subordinates. 

The administrator, unless he is charged with a small and minor mis¬ 
sion, will find it advisable to delegate to aub-administrators all of the 
duties contained in the mission. This will leave the administrator free 
to discharge the responsibilities of general supervision, coordination with 
those on an equivalent administrative level, and to report to and receive 
directives from hia immediate superior. General supervision should 
include: (1) A review of non-routine work submitted to higher authority; 
(2) A review of the assignments of incoming non-routine tasks to sub- 
adminiatrators in order to assure that the original division into sub¬ 
missions is followed or revised when appropriate; (3) A continual review 
of personnel allotments to the sub-divisions in order to maintain equiva¬ 
lent work loads for all concerned os the amount of work charged to the 
sub-divisions fluctuates; and (4) Inspections of the accomplishments of 
sub-administrators, 
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If fclie administrator follows this plan of office organization, he will 
usually discover that from four to six is the appropriate number of sub- 
administrators for his immediate superviBion. 

Having attempted to so organize the functional aspects of the olRce 
to assure wholesome relationships between personnlitics, the administra¬ 
tor can further the realization of the dcsircrl emls by an ai)pr()priato dis¬ 
tribution of office space. This Hlatcment is biwed on tlie assiimjjtion 
that desired cooperation is more likely to onmie if it is made ea.sy, tlio 
parties concerned arc friends, and each o.pj>rcciatt*s the prolilema of the 
others. It is believed that these latter conditions are UHiinlly achieved if 
the aub-adminiatratora arc placed in the same oflicc or in adjoining offices 
and communication between them is readily available at all times. 

It is felt that the above suggested organization tond.a to facilitate 
smooth operation because it decreases the chances Cor personality frictionB 
by lessening the possibilities for misundei'standinga and fru.strationa. 
It charges the administrator primarily with tlio job of making the organi¬ 
zation function properly, 'lliia enables him to forsco possible personality 
diffioultie.s before they arise and to act to correct them before they become 
serious. 

Having organized the office, both from the point of view of space 
assignments and functional reaponaihilitiea, there arc tho problems of the 
relationships of the administrator to his sub-ndministrators, to his co- 
administrators and to his superior. 

Relationships between Admini8ti'c.tor and Superior 
The significance of the relationship of the administrator to his superior 
is realized in part when one recalls that in army life a soldier is responsible 
to his superior for practically everything lie does or fails to do. It is 
therefore incumbent upon a soldier administrator to build a wholesome 
relationship between himself and his superior. In order to achieve this 
end he should learn the details of hia siiperior’a personality. He should 
listen very attentively to everything he says. He should study his 
motivationa and attempt to predict ha reactions to aiUiations os they 
arise. He should put tactful questions when answers to these assist him 
to know better the desires of his superior os they pertain to military 
matters and when tho questions can be put without arousing offense. 
These suggestions derive from the principle that there are wide individual 
differences in superiors and what might appeal to one would bo acted on 
unfavorably by another. The solution is to know tho superior to whom 
one is responsible as well as possible bo that appropriate matters may be 
presented in a manner so as to be favorably received, 

Despite the individual differences in auporiors there are usually some 
principles of approach that will be favorably received bv most of them. 
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It is well to bo acquainted with these because in army life there is often a 
clmngc in the individual to whom any one is responsible, and the gener¬ 
ally acceptable principles have to be relied upon until one can learn the 
personality characteristics 0 / his new Bupeviac. One can try the generally 
applicable principles and observe closely their effects. He can revise 
them in the light of his observations. 

Primary among the generally acceptable principles is the desirability 
of putting one’s suggestions for the accomplishment of tasks or goals too 
his superior in such a way tliat they imply that the administrator fully 
realizes that decisions on the matters arc the prerogative of the superior, 
If any of the suggc.stions are adopted and prove successful, the administra¬ 
tor can usually motivate wholesome relationships, if he makes inherent 
in hU report of the success to the superior the realization that it was the 
judgment of the superior which decided in advance that the ideas would 
bo successful. Tld.s tends to encourage in the superior the feeling of 
ownership for the i)rogram involved and thus the program obtains his 
support more effectively. Several repetitions of this nature create in the 
superior more and more of a feeling of personal ownership for all of the 
programs that derive from the administrator under consideration to the 
end that the latter ol)tains a very high level of support, 

On tliQ other hand, if an idea suggested by the administrator and 
approved by the superior should fail, it is well that the report of failure 
include the realization by the administrator that he suggested the idea 
and accepts re.sjjonslbility for its failure. The necessary derogatory im¬ 
pression ensuing from a report of failure is lessened by including a sug¬ 
gestion—particularly well thought out—to improve or substitute for the 
idea which failed on first trial. 

Many of the suggestions which the administrator recommends to his 
superior will originate with his immediate sub-administrators or even 
lower in the administrative echelon. It is well that the administrator 
credit them to the appropriate individuals when ho recommends them to 
his superior because this is one way in which the administrator can en¬ 
courage his superior to the realization that hia actions am not predicated 
on a mere desire to create a particularly favorable personal impression. 
In addition, to give the credit where due will help one’s relationship with 
one's sub-administrators because the chances are the superior will ac¬ 
knowledge the contribution at some time to the sub-administrators con¬ 
cerned, and the sub-administrators will feel kindly to know that they have 
been given due credit. 

At times the administrator will receive from his superior directives 
with which he may immediately disagree. It is wise that l\e be hesitant 
about expressing liia disagreement unless invited to do so, and then it 
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should be done with reservationB. It may be that the superior, and even 
his eiiperiorw, have spent a great deal of time thinking through and study¬ 
ing the directives. The directives may be tlie product of tremendous 
efforts. For the administrator, a junior, to object with little apparent 
study may not portray due respect and may be unfavorably received 
because of tlie apparent failure of the administrator to give due study to 
the directives before voiciitg his atiitudo toward them. Also if he takes 
time for himself and his sub-administrators to sHuly tlicm and report to 
him he may arrive at more valuable conclusions, wlilcli will be more re¬ 
spected because they have first been given duo considorabion, and the 
superior may not be as emotionally interested in the directives as lie was 
soon after he may have spent hours working on them and thinking about 
them. Also the administrator establishes an attitude of confidence to¬ 
ward himself if he is very cautious about raising problems in coniieGtion 
witli directives to him. He may be able to establish in liis superior the 
attitude that the latter should consider very carefully when the admin¬ 
istrator raises a problem. Such, of course, would be n definite asset to 
the administrator and would probably spread to become a more general 
attitude of regard by the superior toward the administrator. 

Another possible way to build a favorable attitude in the mind of the 
superior and to save him embarrassment as well as put him in a i)osition 
to justly defend the actions of his aubordinates is for the administrator 
to keep the euperior especially well informed on what tranajurcs. This 
applies in particular when the administrator or his staff haa been guilty 
of an oversight or some other type of ncgligonee or when occasion has 
required the issuance to commanders of lower echelons directives to 
which they are expected to object. The chances are the negligence or 
objection will be reported through command channels and will come to 
the euperior from personnel to which he is responsible. He can do much 
to retain cooperation and underatanding among all concerned if he ia in a 
position to give immediately the full stoiy on the matter under considera¬ 
tion. 

There ia of course always a queatiou of the minuteness of matters of 
potential objection and negligence which should be reported to the super¬ 
ior by the administrator. The answer to this problem depends on the 
personal preference of the superior and can uaually bo discovered by 
appropriate questioning when such matters are reported. Ilia preference 
will uaually reflect the attitude of the individuals to whom he is rcai)onai- 
ble and the tendencies of lower and higher commanders in reporting 
objectionable matters. Some commanders will attempt to report their 
objections with reasons to the office which issued the directive involved 
and which appears to be immediately responsible so that a more satis- 
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factoi'y arrangement may be evolved at that level if possible. Others 
will invariably report their objections to personnel in higher echelonB of 
adniinistiation and therefore make it desimble for those personnel to 
keep well informed on the matters because they can thereby make a more 
favorable impression on the objecting commander, who usually ranks the 
administrative personnel, to the end that cooperative understanding has 
a better chance of continuing. 

Ihe points just outlined covering principles that are considered gen¬ 
erally helpful to an administrator in adapting to his sriperior are pi’edi- 
cated on the belief that personal understanding between the two con¬ 
cerned is of primary importance, that the administrator as the junior 
should consider it his responsibility to make whatever adaptation is 
necessary to accomplish the desired relationship, that the administrator 
should regard himself ns an assistant to the superior in the accomplish- 
ment of the latter’s mission, that frankn^s and cooperation are essential 
to personal understanding, and that credit will accrue to those to whom 
it ia due much more readily if they make no obvious moves designed 
merely to enchance it—and besides—self credit, especially in a war effort, 
is of no consequence; the one great dedication should be successful and 
efficient prosecution of the war. 

Relationships between Administrator and Sub-Administrators 

The fundamental fact to keep in mind in considering the relationships 
of the administrator to hig sub-administrators is that the discussion is 
here pitched at that echelon where the size of the mission is so large that 
its accomplishment has been entirely delegated—leaving the administi'a- 
tor free to give his full time to the supervision of his subordinates. The 
administrator is dependent upon his subordinates for accomplishment of 
the mission, and his success depends on his qualities of leadership in a 
particular field. His job is to assure that the maximum achievements 
are realized by his subordinates. These achievements must be realized 
as a functional component of a much larger whole. They must be ap¬ 
propriately adjusted to the much larger functional framework. The 
adminiatrator must therefore be a successful teacher. He must bo able 
to give his sub-administrators a clear concise picture of the mission for 
which he is responsible. He must be able to give a significant and mean¬ 
ingful picture of how this mission fits into the larger framework. He must 
be able to teach each sub-administrator to realize and compi’ehend his 
particular goal in its perspective to the goals of other sub-administrators 
and in perspective to the still larger functional framework, He can test 
his success, If his subordinates are making recommendations which his 
knowledge of the overall situation frequently reveals to him are inap¬ 
propriate, then he ia not keeping his subordinates sufficiently well in- 
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formed—and if he ia passing tliese recommendations on approved to 
higher administrative echelons where they arc not favorably considered, 
then he is not keeping himself nor hia suboitlinatcs siifFiciently well in- 
formed. The suggestions just offered are believed to derive from the 
principle that appropriate aclucvemcnts dcimnd on clear cut undor- 
standings of iniHsions and that one characteristic of lo.sijeetcd leadership 
depends on nn unbiased ability to search onc.sclf and one's organization 
for shortcomings before blaming one's subordimiLcs, 

If the shortcomings are discovered in oneself, one; must take immedi¬ 
ate steps to correct them, and one way that one can usually assure liimself 
that he and hia subordinates arc sufficiently well informed to properly 
discharge their duties is to attempt to keep him.self aiifriciently well in- 
, formed to accompliali the mission of liis superior and frankly attempt to 
keep his immediate subordinates sufficiently well informed that any one 
of them could step into his position. This has the effect of keeping a 
personal goal immediately in front of all personnel concerned and acts as 
a strong motivating factor. It also makes a very favorable impression 
on superiors to observe the continued smooth functioning that ensues 
even though key personnel arc suddenly lost as bo frequently hiii)pen3 in 
many army organizations. 

The above suggestions encom'age successful leadership through careful 
inabriicbions to subordinates- Another method of giving direction to the 
work of subordinate is for the administrator as the lender to assist hia sub¬ 
ordinates to know hia pcreonality charaoterLstics. The better able he is 
to acquaint them with his personality charactcristic.s the better able they 
will be to follow his desires. Ho will assist his subordinatea in this respect 
if he always gives reasons for his decisions. In addition, this policy 
makes him very careful of his decisions and often prevents him from 
making errors of decision, especially so, if he creates m his subordinates a 
feeling of freedom to express disagreements. This feeling is enhanced if 
Buch expressions arc always given careful and tactful consideration and if 
appreciation is shown for them even though they arc not accepted. The 
approach just offered is believed to derive from the principle that freedom 
of action—herein fostered by an overall knowledge of tiro mis.sion plus 
responsibility for definite goals—encouragea initiative. 

Initiative can often be still further cucoui-aged by emphasizing respon¬ 
sibility to personnel to whom goals are ns.mgncd. Such personnel will 
sometimes come to the administrator with quoHtions designed to obtain 
the solution from liim—and for the admiiiislrnlor to give it will encourage 
dependence upon him at the c:q}cnsc of properly developing his subordi¬ 
nates. 

The assignment of goals also obligates the administrator from the 
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should at least give them an opportunity to express their opinions on 
matters prior to a decision having been made. To comply with this 
obligation should not only assist in developing and maintaining desired 
personal relationships but should also produce valuable ideas which 
might otherwise be overlooked. 

The suggestions enumerated above are based on the principle that 
smoother personal relationships are maintained and more is achieved 
when all personnel are given a clear cut understanding of their responsi¬ 
bilities, are taught to exercise their initiative, and the initiative of all is 
given proper direction by means of keeping all personnel sufficiently well 
informed so that they have proper perspectives for expressing themselves. 

Relationships between Administrator and Co-Administrators 

By keeping oneself especially well informed and by thinking out ones 
decisions with ones sub-administrators, as just outlined, the administrator 
keeps himself peculiarly adept to deal effectively with his co-administra¬ 
tors, with whom he must cooperate and with whom he is often in competi¬ 
tion. He must cooperate mth tliem because all are working for the ac¬ 
complishment of the mission of their common superior and for the greater 
goal of successful and efficient prosecution of the war. He is often in 
competition with them because all are often highly motivated by the 
superior, all are rated as to efficiencies by their superior, and disagree¬ 
ments arise as to how the mission of the superior should be accomplished 
and as to whom of the sub-administrators should be responsible for the 
various aspects of the mission. The adminfatrator who is well reinfoi ced 
by knowledge and carefully thought out principles has the advantage 
because he is prepared for discussion periods which usually arise suddenly, 
In alternative solutions that arise in these discussions he should take only 
efficient accomplishment of the mission of his superior as the primary 
purpose, and this principle in conjunction with an unusual background of 
pertinent knowledge will give him a solution for which he can acquire 
support through an intellectual, non-emotional, presentation. This 
presentation will encourage better personal relationships if the intellec¬ 
tual contributions are offered in the form of suggestions and if the con¬ 
tributor takes advantage of every opportunity to evolve them from the 
personnel in the discussion. He will then usually be admired by hia 
colleagues and appreciated by his superior. 

The proposals herein offered for efficient functioning of an administra¬ 
tive organization are analogous to those often proposed for the healthy 
minded functioning of a human organism. They derive from the primary 
principle that efficiency will ensue in the organization, or organism, if 
there is a clear cut goal adjusted to the capacity present and if all com¬ 
ponents are carefully directed and motivated toward its realization. 
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RL'sinn6 and PsyehologiwU PoaaihilitieH 

This paper was motivated by Ibo realization that nGV(!r before have 
psychologists coiitri])utc(I so much in ao many iiaaigiimeiilH heretofore not 
filled by personnel osiiecially trained in the understanding of l)eliavioi'. 
The cKigeneicfl of war and the success of some military p.sych(jh)gists in 
iion-apccializecl nspeets of their nHsiunmcnts have placed them in these 
pursuits, This unusual situation demands (liseiission in oi’der that it may 
be properly evaluated, in order Unit fvdl advantage may \w, taken of its 
opportunities, and—more spceifically—in onhu* that p.sycliologifjts in 
these assignments may take advantage of the ctmtriliutionH of their 
colleagues. 

Tlie'paper oiitlinea p-sychological n|)j)roiiehes tluit liave been applied 
to certain army administrative ju'obloms. The disoiissioji is pitched at 
that level where the administrator must dfi|)end entirely on hi.s .subordi¬ 
nates for the ncflomplishmeiit of the tasks. Ills nehio^'eitHmt depends on 
leadership and organization. lie teaches Ills suboi'diniLic^s to understand 
clearly their goals in proper perspective to the larger missions. He en- 
courngGs and devclojws respon.sibility, initiative and (((‘termination in 
hia subordinato-s and gives them the maximum authority Ju.stiricd by 
their, understanding of the missions. IIo c.staldislie,s (in organisation 
which facilitates wholosomc personal rclaUoii.shipH and whicli iniiiimizes 
th(3 amount of coordination required. He inotivate.s maximum effort 
and direct,s it into the channels whore it is ino.st productive. 

It is hoped that this paper will encourage oilier similar discussions. 
It may be that these discu.s.sions would reveal many iisychological ap¬ 
proaches which could be applied to practical pursuits of iienee time living. 
It may be that material could be gleaned for psychological (U)Ur,‘5cs in 
biisincas administration imd othm* practical subjeets. It may be that 
many psychologists have been developed into practical lulininistrators 
and executives capable of outstripping their iion-s])ocializecl competitors. 
And, it may bo that many occupational pursuits, now considered non¬ 
professional, involve so many psychological considerations that they 
could be more effectively disclmrgcd by personnel specialized in the 
understanding of human behavior. 

Receincd Aiioust 20, 



A Statistical Study of Visual Functions and 
Industrial Safety 

N. Frank Stump 

General Personnel Department, Revere Copper and Brass Incorporated, 
Rome, New York 


The purpose of this study was to determine the statistical significance 
of differences between average visual performance for various accident 
groups, rjiree groups evaluated from fii'st aid I'ecords were compared: 
(1) An Accident-Free group, (2) A High-Frequency-of-Minor-Accident 
group, and (3) A Serious-Injury group. The employees were classified 
in each of these groups by the Safety Engineer, a Personnel Assistant, 
and the Author, after thoroughly examining the individual accident 
records for a twelve-month period. 

Visual Tests Used 

Twelve visual tests were administered to the three employee groups 
having various past histories regarding accidents. The complete set of 
tests are incorporated in the Bauset and Lomb Ortho-Raier} They are; 

1. Acuity, both eyes, far and near distances; 2. Acuity, each eye 
separately, at far and near distances (not occluded); 3, Vertical and 
Lateral Plioria,^ or Muscle Balance, at far and near distances; 4. Color; 
and 5. Depth or Stereopsis. 

Since the tests for "Acuity, each eye separately" were administered 
without occlusion, both eyes were functioning normally, even though 
each was being tested separately. The natural-function method is far 
superior to the obsolete procedure of placing a cardboard before alternate 
eyes when testing, Unfortunately, this latter metliod is being generally 
\ised today for certifying auto drivers throughout the country, and for 
testing industrial employees during medical examination. 

Kesults 

Table 1 shows Means and Critical Ratios for 22 visual test scores 
including various score combinations. If raw scores from only twelve 
Ortho-Rater teats were considered, the number of comparisons between 
visual functions would have been limited. By combining these raw 

1 For description of these teata sec: Siondord Practice in the Adminislration of the 
Bauack & Lomh Occupational Viaim Teals wilk the OHfuhRater, February, 19‘f4. 

* Joseph Tiflin, Industrialpaychohg]/. New York: Prentice-Hall, Inc., 1942. Ch, VI, 
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Tftl)le 1 

Means nnii Crilicftl UaLioa of TIitcb Accident <iro«iiH Compared with Uegard to 
VarlouB Vifiuni FunclionN 

(Note: A « Acc5dcutrl''rec| H Iligh-Frcaueticy; C 8<Ti(]iiH*Tn)iir>’. = 108.) 

McatiH Critical Itatios 


Testa 

A 

li 

C 


1 

•< 

ilfirilfo 

1. Acuity—lloLliEyoa—Far 

10.ftl 

10. M 

0.83 

2,23 

1.09 

.05 

2. Acuity—Ilight Eye—Far 

9.8'J 

8.83 

8.80 

2,13 

2.20 

.05' 

3. Acuity—lAttEyc—Far 

O.RO 

8.07 

8.01 

2,0(1 

2,08 

.08 

4. Acuity—UelUsrEye—Far 

10.63 

0.72 

0.00 

2,03 

2.21 

.00 

6. Acuity—WorsflEyc—Far 

0.25 

7.78 

7.78 

2.63 

2,50 

.00 

6. Lateral Plioria—Far 

7.44 

0.72 

7,19 

.37 

1.2r) 

.67* 

7, Vertical PliOria—Far 

5.60 

5.25 

4.02 

1.75 

1.02 

80 

8. Acuity—Both Eyes—Near 

11.08 

10.60 

10.58 

.08 

.87 

.21 

9. Acuity—flight Eye—Near 

O.OB 

8.68 

8.92 

.18 

.70 

,60* 

10, Aculty—LoftEye—Near 

0.01 

0.28 

0.00 

.02 

.57 

,33 

11. Lateral PUoria—Near 

0.33 

7.14 

7.31 

1.23‘ 

1.02* 

,21' 

12. VerUcalPhoiia—N cm 

13. Lateral Phoria—Near eub- 

4.01 

4.01 

4.00 

1.84 

.00 

1,60 

traded from Far, plus 10 

14. D.cLtcrEyo—Ncaraub- 

11.11 

0.68 

0.69 

1.77 

1.D9 

,39’ 

traded from Far, plus 6 

16, WorsoEyo—Near 9ub- 

6.63 

4.64 

4.80 

1,00 

1.63 

.69' 

traded from Far, plus 0 

0.01 

6.07 

5.68 

1,84 

1.04 

.72 

10, Worse Eye—Near 

8.04 

7.80 

8.17 

.77 

1.24 

.44* 

17. Better Eye—Near 

10.00 

10.03 

0.81 

.30 

.06'® 

.40 

IS. Depth 

6.64 

3.53 

4.72 

1.31 

3.27 

1,00" 

19. Color 

20. Vortical Plioria—Near sub- 

4.44 

4.26 

4.31 

.44 

.00 

.17" 

traded from Far, plus 3 

21. Acuity—Both Byes—Near 

3.80 

3.04 

3.92 

.08'* 

.00 

.78" 

eultraclcd from Far, plus 6 
22. Total for 7 tests—Both; 
Right; Left; Better; Worse; 
(Fur Vision) Lat. Phoria, 

4.72 

4.44 

4.25 

.82 

,67 

.39 

Near from Par; and Depth 
23. EducatioQ—Grades com- 

07.08 

68.25 

69.39 

2.09 

5,41 

.44" 

pleted in scbool 

8.53 

0.00 

8.66 

.06'^ 

,90'^ 

.82 


Explanation of footnote numbors: Tlic following combinations should rend Mc-~Ma 
4, la. 1(3; Md-Ma 5, 10, 17; and Mc-Mn 1, 2,3,0, 7, 8, 0, ll, 12, 14,16. 


scores into different combinations, howevor, a total of 22 actual and 
alloyed values resulted. 

Educational Status of the Three Groups Compared 
The number of school grades completed was taken as an indication of 
the mental alertness of the individuals. Some studies have been made 
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which indicate that the amount of schooling received is a fair index of 
general ability, It was regarded, therefore, as essential to hold education 
fairly constant, on the average, for the three groups. The Critical 
Ratios between llie three injury groups indicate that the average differ¬ 
ences in schooling received by these groups are not significant,^ the 
Critical Ratios for tlie Accident-Free group as compared with the Iligh- 
Frcqucncy and the Serious-Injuiy group being .90 and ,05, respectively. 
The Critical Ratio of the High-Frequency group when compared to 
Serious-Injury group was . 82 . 

Accident-Free vs. Serious-Injury 

Tlie data reveal that the Ortho-Rater Means show a significant 
difference in favor of the Accident-Free group over the Serious-Injury 
group in the following visual functions: (a) Acuity—both eyes, far vision; 
(1)) Acuity-right eye, far vision; (c) Acuity—left eye, far; (d) Acuity- 
bettor oye, far; and (e) Acuity—worse eye, far. 

When seven of the visual tests in the Ortho-Rater were combined a 
highly significant dilference resulted between the Mean scores of Accident- 
Free employees and Serious-Injury scores, the Critical Ratio being 2,69. 

Accident-Free vs. High-Frequency 

Critical ratios exceeded the criterion when the Accident-Free group 
was compared with the High-Frequency group on the following test data: 
(c) Acuity—right eye, far; (i>) Acuity—left eye, far; (c) Acuity—bettor 
eye, far; (d) Acuity—worse eye, far; and (e) Depth. 

Special mention should be made of the Critical Ratio of 1,09 of 
Lateral Phoria,—near subtracted from far. Since this Critical Ratio is 
only .04 below the criterion, a definite trend is unquestionably indicated 
here. 

The combined total of seven visual tests indicates a highly significant 
difference between the Mean scores of the Accident-Free and of the High- 
Frequency group, the Critical Ratio being 5.44. 

High-Frequency vs. Serious-Injury 

Not a single Critical Ratio meets the criterion (2.03) for significant 
difference between these two groups. Tiiese findings are what one should 
naturally expect, provided the personnel for these experimental groups 
were ])i'ojJui ly evaluated. It is generally agreed among authorities in the 
field that a High-Frequency ca.se is a potentially Serious-Accident case; 
so, the preseni Serioiis-Accidcni individual is, in many case,s, the preuious 
High-Frequency individual. Tills thesis is impoi'tant in tlie prediction 

M, P, Guilford, Psyckomelric methods. New York: McGrnwlIill Book Company, 
Inc., 1930, 548-549. A value of 2.03 is the criterion Bclcotcd for significance. 
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of the eventual Serioiis-Injui'y indiviiliial on llio ha«is of lliKh-I'Vequency. 
This fact in furtliei'miljHtuntiatod by tlie low Oiliciil Kiitin, wlien a com¬ 
posite of seven visual seorcM was Hludied hoUveen the IliKh-Fniciuoncy 
and Serious-Injury Ki'oup. 

Of cciurso, tlicrc arc some exceptions to the rule, 'riicre may he smne 
peivSona who have serious aecidouLH hut who never luu'c been eliissified as 
[lie Iligh-Tiequeucy type. Nevertheless, these data supixu li the above 
Ihcsis (puto well, 

Visual fvinctiona RCem U> l>e an imiiovtant ejmivib\iting five,tor for the 
safely of the imhistriftl worker, Ol)vio\i.sly, many fiielors antin' to make 
an employee an ab.solutely safe worker, hut visiml finielions have only 
recently taken tlicir place as being equally as iinpnrlanfc as, if not more 
important than, other factors covered in theliterntui'c on safety. 

Summary 

(1) The Accident-Free group is significantly superior in visual 
functions to the Serious-Injury group and also to the nigh-l'Vwiuoncy 
group in the following: (a) Acuity-right oyci—far vision; (b) Acuity— 
left eye—far vision; (c) Acuity—bettor eye—far; and (d) Acuity—worse 
eye—far. 

This points to conclusinnH similar to those reached in prcviou.s exjicri- 
monts reported by the writer.^ It is well to note that the Accident- 
Free group earned significantly higher scores in visual performance for 
the poorer eye than did the other Wo groups. 

(2) Acuity, Both Byes, Far Vision scores indicate tiio Accident-Free 
group to be superior to the Scrious-Accidcnt group, 

(3) Depth perception is present to a significantly higher degree in 
the Accident-Free group than in the High-Frequency gi’oup. 

(4) In addition, there scom.s to be a trend in the direction of the 
visual functions and safety; Lateral Phoria—Near subtracted from 
Lateral Phoria—Far. 

(5) When o composite of seven visual functions was made the Acci¬ 
dent-Free group was superior to the High-Frequency and Scrious-Iujury 
group, the Critical Ratios being 2.69 and 5.44, respectively. 

Received December 7, 1044 ^ 

^Visual funclionB oh related to accidcnt-pronenci^. PerenaneJ, IQ'H, 21, 60-^0; 
Spotting tlio aQcidonlriJioao warkcra by vinual tcala. Pact, Mgmt., lOtri, L03, 109-112; 
Visual functions and safety, Nal. Safely Hem, lO-M, 49, 22 IT, 



Effect of Visual Adaptation Upon Intensity of Illumination 
Preferred for Reading With Direct Lighting * 

Miles A, Tinker 
Vniuer^ty oj Minnesota 

A reader rarely heaitatea to express a preference for what he considers 
to be an adequate light intensity for easy and comfortable reading. 
Luckieah and Moss (4) claim that this subjective method of investigation 
yields both significant and interesting results. Although they admit that 
such results are not desirable for laying a scientific foundation for lighting, 
it is employed by them as corroborative evidence. In general, prefer¬ 
ences for illumination intensities have been employed for two purposes: 
(1) as supplementary data in prescribing foot-candle standards for reading 
and (2) to persuade consumers that a high level of light intensity is de¬ 
sirable. The validity of such practices may be questioned. In this paper 
the plan is to examine critically the evidence in the field and to present 
new experimental data on the validity of preferred intensities as a meas¬ 
ure of ease of seeing. 

Review of Previous Experiments 

In a study by Luckieah end Moss ( 4 ), 82 subjects selected the intensity 
of illumination considered as ideal for an extended period of reading black 
print on white paper. The readers employed their own criteria of com¬ 
fort afforded by the lighting. Intensities from 10 to 1,000 foot-candles 
were available. Preferences were distributed as follows: 11 per cent at 
10 foot-candles, 18 at 20, 32 at 50, 20 at 100,17 at 200, 1 at 500 and 1 at 
1,000. Although it is stated that the subjects chose an average of about 
100 foot-candles, the authors do not note that the median was at 50 in 
this atypical distribution. It is common statistical practice, of course, 
to use the median rather than the mean in atypical distributions. In 
another report (1) Luckiesh states that many observers chose 370 foot- 
candles of illumination for comfortable reading. The readers viewed an 
illuminated page of a telephone directory through a small window in a 
black box. Nothing is said concerning the visual adaptation of the sub¬ 
jects. Little confidence can be placed in this uncontrolled experiment. 

Several other experiments have been performed. Luckiesh, Taylor 

* Grateful ttcknowlcdgment is gjvcn to the Graduate Seliool, University of Minne¬ 
sota, for research grant to hnance this study. 

471 



472 


Miles A. '/'inter 


and Sinilcn (2), employing well distrilnitcd K<*iicrul illumination, found 
tliat Bubjecta prefevred on the average ri.It font-ciimlles for rca<liug 11 and 
12 point tyjic, and 10,G to 16.1 fnot-caiuUca for 0 point, For a low degree 
of contrast between 9 point type and printing HiiTfivee, 17.>1 foob-eandlea 
were cbosen when 30 were avnilalde. In another alvnly wilii well diffused 
gciicml ilhiminatinn, Luekioah lunl Taylor (‘.1) obtained preferonceH of 
illumination intensities for rending 9 point typo. With up to 8 foot- 
candlcR available, the roadnra chose 4.2; with‘.10, iD.Oiwith 45, lO.liwith 
65, 23.2; and with 100, 35.8. It wn.s concluded that the Teftflors did not 
choose the maximum because they probably aHHumed that the desired 
intensi ty was somewhere ))etwceii the extremes. This conohrsion appears 
unwarranted sinco in tlie experiment cited above (4), in wliich preferences 
were made solely upon the hft.si.s of the rcader'.s own criteria of comfort 
afforded by the lighting and with no .suggestion that one’s choice should 
avoid extremes, the median choice was only 50 f(M)t>caii(llc3. 

Why do sucli difTeront ch()icc.s appear when tlie rcjador exj^rc.sses his 
prcfci'cncG for the illumination intensity bc-st suited foi’ comfortable 
reading? In the data cited above, there in a.suggestimr tliat visual adapt¬ 
ation at the time of the choice plays a dominant role in the choice. As 
the eyes arc cxpo.sed to a greater range of intcn.sitics, ))a) tiiil a(la))Lation 
to brighter illumination may ociuir and this can lead to a ('.hoico of more 
foot-cancllo.s for comfortable reading. It i.s well known that vision readily 
adapts to easy and efneient seeing within a wide rnnRo of illumination 
intensities. To test the liypothesis tliat visual a(lai)tatiori innuoncca the 
reader's preference for the illumination Intejisity host for comfortable 
reading, an experiment was carried out by Tinker (0). Tlmro were 144 
readers lasted. At one sitting a subject was adapted for 15 minutes to 
8 foot-candles intensity and then chose, l)y the paired comparison metliod, 
between 8 foot-candles and each of the following intenHitic,s: 1, 2, 3, 5, 12, 
18, 26, and 41 foot-candle.s. There was a four minute rcadaptation to 
the 8 foot-candles before cncJi succeeding choice. At the otlicr sitting, 
the subject was adapted to 52 foot-cnndics and then cliose between 52 and 
each of the following intensities; 18, 30, 41, 46, 59, 02, 71, and 100 foot- 
candles. When adapted to 8 foot-candles, 8 foot-candlcy wn.s preferred 
moat frequently for easy and comfortable reading, hut the median was at 
12 foot-candlcs. Similarly, when adapted to 52 foot-ciindlea, the median 
choice was for the intensity to which the subject was adapted. It seems 
clear that visual adaptation at the moment ^Ictcnnines to a large degree 
the intensity preferred for reading undci* general ilKimination. 

In a preliminavy study of illumination intensities prof erred for reading 
under direct lighting, Aasen, Burwcll and Harmon (cited by Tinker, 7) 
obtained choices in a situation which approximated the light from the 
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old-fashioned type of bridge lamp. The reader explored over a range of 
from 1 to so foot-candles. When progressing from low to high intensi¬ 
ties, the mean choice was 21.5 foot-candles; from high to low intensities, 
28.9 foot-candles. In a similar study of preferences of illumination in¬ 
tensities for reading, Tinker (7) employed metal shade, flexible arm read¬ 
ing lamps which yielded strictly local illumination. The mean intensity 
chosen by the readers was 42.6 foot-candles when 3 to 160 were available. 
Although visual adaptation was not adequately controlled in either of 
these experiments, there are indications that variation in adaptation was 
influencing the results. Thei-e is need for further experimentation in 
this kind of situation with strict control of visual adaptation. This is 
done in the following study. 

Description of Experiment 

The purpose of this experiment is to determine illumination intensi¬ 
ties preferred for easy and comfortable reading under strictly localized 
lighting when visual adaptation is controlled. The experiment was con¬ 
ducted in a light laboratory with no outside windows, hence rigid control 
of illumination was possible. Six standard, metal shade, flexible arm 
reading lamps equipped with regular frosted bulbs provided highly local¬ 
ized lighting, The fairly uniform spot of illumination on the reading 
stand was about 10 inches in diameter. From the perimeter of this area 
outward, the illumination decreased rapidly in intensity. 

Sixty university students served as subjects, There were two ses¬ 
sions of 50 minutes for each subject. At each session, the subject was 
adapted to a certain standard level of illumination intensity. At one 
sitting this level was 20 foot-candles; at the other, 50 foot-candles. Half 
of the subjects began with the 20 foot-candles, the other half with 50 foot- 
candles. 

The subjects observed one at a time. When a subject arrived at the 
laboratory, he spent 15 minutes adapting to the standard illumination 
(20 or 60 foot-candles). Near the end of this period, he was directed to 
do some sample reading of the printed material that was to be used in the 
experiment. This text (Winkler’s Morgan the Magnificent) was printed 
in 11 point type with 2 point leading and a 23 pica line width on mat 
white paper. At the end of the 15 minute adaptation period the follow¬ 
ing directions wore read to the subject: 

“I am going to ask you to decide which of several brightnesses of light 
you prefer for reading. Decide in terms of the light which, seems most 
comfortable for reading. You will be asked to read a few lines under a 
standard light-—the one now on—and then under a comparison light. 
After trying this for a couple of times, you will Choose which light you 
prefer for reading. Several lights will be compared with the standard. 
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Ten seconds after notifying the subject that the light now on Avns one 
of the lights to be compared, tlie standard was swildicd off and simultane¬ 
ously the comparison light was switched on. Ten seconds later the 
whole procedure was repeated and then a choice asked for by asking, 
"1)0 you prefer tUia or thia?". Tlic aubjcct was reaclaptoxl for 2 minutes 
to the standard intensity before the next choice, 'i’ho 20 foot-candle 
standard was compared with 4, 10, 50, 75 and 100 foot-caiullc.s in a 
random order. For every alternate subject the random order wns 
different. The 50 foot-candle standard was compared with 4, 10, 20, 75 
and 100 foot-candles with a similar randomized presonLation. Thus each 
subject made five choices under each of Hie two condition.s of adaptation. 

The illumination intensities wore checked every day with a recently 
calibrated General Electric Foot-Candle Meter to be sure that the inten¬ 
sities were accurate as planned. 

Results 

The frequency with which each intensity wns chosen as best for easy 
and comfortable reading was computed. Since the standard intensity 
was compared with each of the five other intensitiG.s, it appeared five 
times as often as each of the comparison lights. It was nece.ssary, there¬ 
fore, to divide the Crequeney of choice for the 20 and for the 50 foot- 
candles by five to make these figui'os comimrable with the others. The 
results, showing these adjusted data, are given in Table 1. In the first 

Table I 

Illumination IntciiBitica Prefeircd lor llcndinR With Direct IjightinK 

Note; In top section of table, tlie 20 foot-cnndlc light wns compnrocl sepiirntcly witli 
4, 10, 50, 76 and 100 loot-candies. N = CO university sUiilciitvS, Under these condi¬ 
tions, 4 footrcandlea^werc chosen 13 times (7 per cent) out of 184 etTeclive choices; 10 
footrcandlea, 13, etc. The bottom Hcclion of the Inble is rend in a similar manner. 
H&re the Blandnrd wo-s 50 foot-candles. 




Adapted U) 20 Foot^cnndlos 


Toot-candles Compared 

4 

10 

20 

50 

75 

100 

Choice frequency 

13 

13 

29 

40 

42 

41 

Percentage frequency 

7 

7 

16 

25 

23 

22 



Adapted In 50 I'’<)Ot-cftndlofl 


Toot-cnndles Conumrod 

4 

10 

20 

50 

75 

100 

Choice frequency 

13 

13 

18 

37 

35 

37 

PcrcBvrtnge frequency 

0 

9 

U 

24 

23 

24 


row of each part of tho table are listed the intensities of illumination 
compared. Just below are ^ven the frequencies with which each inten¬ 
sity was chosen as beat for easy and comfortable reading of the 11 point 
type, Percentage frequencies are listed in line three. In reading the 
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tabic it slioviirl be remembered that each intensity was compared with the 
one to wJiicli the subject was adapted. 

Examination of the data reveals that visual adaptation at the moment 
appears to determine to some degree the choices made, but that it does 
not play tlic dominant role found by Tinker (6) in the study employing 
general illumination. Eor instance, when adapted to 20 foot-candles, 
tliero wore 29 choices (1(1 per cent) nt 20 foot-candles. But when adapted 
to 50 foot-cnndles, there were only IG choices (11 per cent) at the 20 foot- 
candles level, Before adjusting the data by dividing by five, there were 
145 choices at 20 foot-candlea when adapted to that intensity, and 186 
clioicGs at 50 when adapted to tjie 50. 

When adapted to either’ 20 or 50 foot-candles, choices ranged from 4 
to 100 foot-candles. But tlie domioant tendenc}^ in both sets of data is 
to prefer relatively bright illumination in this strictly local lighting situ¬ 
ation. Thus, 50, 75, 100 foot-cancllcs were chosen most frequently ir¬ 
respective of the intensity to which the subject was adapted. The 
tendency to choose relatively high intensities for reading under strictly 
localized light agrees with an earlier finding (7). 

This preference for relatively bright illumiuation for reading under 
strictly localized direct lighting has unfortunate implications for the 
hygiene of vision. It has been demonstrated that local direct lighting 
such as employed in this experiment is unhygienic (5). A email spot of 
bright light surrounded by dimly illuminated areas and shadows iu the 
visual field provides a situation that rapidly produces visual fatigue. 
It is the lack of uniform distribution of illumination in the visual field 
that is bad, In a situation of this kind, the greater the intensity of 
illumination, the worse it becomes for visual work since the demarkabion 
between the small bright area and the dimly illuminated surroundings 
becomes more pronounced. In fact, the subjects in the earlier experi¬ 
ment on direct lighting (7) were much disturbed by the uneven distribu¬ 
tion of, illumination in the visual field, especially when higher intensities 
were employed. Nevertheless the readers do choose the higher intensities 
under the direct lighting. 

Literature on the subject (5) points out that when local lighting is 
employed it should be supplemented by gcnei’al illumination to avoid an 
undesirable degree of brightness contrast within the visual field. This 
liygienio principle is unknown to many and frequently ignored by others. 
It is of some importance, therefore, to point out that the undesirable 
features of such a situation are accentuated as the light intensity is in¬ 
creased. Apparently, therefore, it ia unsafe to follow individual prefer¬ 
ences ns to what seems to be the beat intensity for comfortable reading 
with strictly local lighting. If such a light ia used, relatively low intensi¬ 
ties produce less visual fatigue. 
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Summary and Conclusions 

1. A survey of the literature revcnlg a wide range of intensities of 
illumination chosen as best for comfortable reading under general lighting. 
Visual adaptation at time of choice largely determines the intensity pre¬ 
ferred. 

2. The purpose in this experiment was to determine the effect of visual 
adaptation upon illumination intensities preferred for reading vuidcv direct 
lighting that is strictly local. 

3. The illumination used was derived from standard metal shade, 
flexible arm reading desk lamps. Range of illumination avaihiblo was 
from 4 to 100 foot-candles. 

4. Sixty subjects observed at two sittings. At one sitting they were 
adapted to 20 foot-candles; at the other, to 50 foot-candles, After 
adaptation, each subject chose between the standard to which he was 
adapted and each of five other intensities on the basis of the intensity pre¬ 
ferred for easy and comfortable reading. 

6. Visual adaptation at time of choice influenced the choice only 
moderately. 

6. There was a marked tendency to prefer intensities at and above 
the brightness to which the subject was adapted. This resulted in fre¬ 
quent choice of high intensities. 

7. Since, in direct lighting such as used here, bright intensities make 
a bad situation worse from the viewpoint of hygienic vision, preferences 
for illumination intensities for reading yield unsatisfactory data for pre¬ 
scribing lighting for the individual. 

Rec&ived November 22, 
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Mechanical Aptitudes of University Women 
Lillian G. Portenier 
Ths Univemiy of Wyoming 

With wartime economy demands emphasizing the already existing 
educational and cultural needs for gi’eater mechanical training for uni¬ 
versity women the Detroit Mechanical Aptitudes Examination was ad¬ 
ministered to four hundred twenty-five women students at the University 
of Wyoming during the winter quarter 1942-1943, The revised edition 
was used. The Detroit test was chosen since, according to the authors, 
many of the items appeal to girls making the teat suitable for both sexes- 
The same set of norms is used for the two groups. The variation of only 
one to two per cent between, the sexes was not believed to be sufficient to 
warrant complete sets of separate norms. No appreciable difference 
could be detected in the median scores. 

The similarity in achievement for both sexes for the Detroit test 
differs markedly from the results found for the Stenquist Assembling 
Test, Stenquist (8) reports that elementary school girls obtained only 
about 65 per cent as many correct items as boys, and that women in 
graduate school obtained about 80 per cent as many correct items as un- 
Belected adult men. Similar differences were found in an extensive in- 
vosligation in which the Minnesota Mechanical Aptitude Tests (7) were 
used with seventh grade boys and girls, and sophomore men and women 
in the college of Science, Literature and Arts at the University of Minne¬ 
sota, The scores made by the university women were about the same as 
those made by seventh and eiglith gi*ade boys. The differences were 
most marked in a mechanical assembly test and in comprehensive tests 
of mechanical information. In general, the difference in males over the 
females increased somewhat in the older groups. 

At the present time the available data appear to be inadequate to 
indicate whether differences in mechanical aptitudes between sexes or 
between individuals within each sex are due primarily to differences in 
general ability or to a special ability or abilities, Freeman. (5) states, 
“One may well question whether it is appropriate to speak of mechanical 
ability aa dissociated from general ability, that is, as a special ability.^’ 
The results of the Detroit Mechanical Aptitudes Examination administ¬ 
ered to the women students at tlie University of Wyoming were analyzed 
largely for the purpose of throwing further light on this question. 
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Of the womoa tested 48 per cent were fiushmoii, 24 per cent soplio- 
mores, 15 per cent juniors, and 13 per cent seniors. Tliorn are eiglit aub- 
teats in the Detroit Examination. Tc.sts two and ei^liL were dcaifriicd to 
measure Motor Ability; tests tliree, five, and seven, Visual Imagery; 
testa one and six, Mechanical Informnlion, and lest four, Ariilimetic. 
TJic “norms arc based on ten thousand scores, ehielly tlie un.selectcd 
groups of pupils at the eighth and niiilh gnule levels in l)(5Lt’oiL. How¬ 
ever, the examination has been given also to several hundrod mentally 
subnormal ciiildrcn, to some normal fifth and sixth grade pupils, and to 
small groups in the senior high school as high as the twelfth grade.'' 

Table 1 

Mediflns, Meaas, Standard Devialiona, Ability Ages and llalings for tlia Scores on tlio 
Detroit Mechanical Aptitudes Examination, and the Oliio Slate 
UnivctRily TcbL, for University lYoinou 


Teat 

Num¬ 

ber 

Me¬ 

dian 

Mean 

S-D, 

Arc 

llalinga 

Detroit Mcchauical Apti¬ 
tudes 

Part I, Motor Ability 

425 

6Q.QQ 

60.80 

8.45 

10-3 

A, Very Superior 

(Teals 2, 8) 

Part II, ViflUal Imagery 

425 

01.11 

85.25 

17.55 

17-2 

H, Superior 

(Teals 3, 5, 7) 

Part III, Mechanical 
Information 

426 

60.20 

49.85 

8.85 

1(3-9 

B, Very Good 

(Teals 1, 0) 

Partly, Arithmetic 

426 

30.87 

.30.94 

0.30 

18-8 

D, Very Superior 

(Test 4) 

Total Scores 

425 

229.20 

226.08 

3o.eo 

17-5 

B+, Superior 

(Tests 1-8 inc.) 
O.S.U, PaycholoBical 
Partllj Analogies 

390 

30.50 

31.00 

11.C5 


53%ilc 

Total Scores 

396 

80.00 

80.25 

25.31 


55%ilo 

(Parts I-II-III) 







Since the Ohio State University Psychological Test is administered to 
all students at Wyoming as high school seniors or after enrolling at the 
University the results of this test on file in the personnel deiMirtineiit were 
used as a basis for determining the general mental ability of the women 
used in this study. The medians, meaiiH, atandiird (loviations, mechan¬ 
ical ability ages and ratings for the scores on the siibtc.Ht.s and on tlie total 
teat for the Detroit Examination, and for Part II, analogic.^, and for the 
total score on 0. S. U. Teat arc shown in Table 1. The mean jjercentile 
rank on the 0. S. U. Test for the group is strong average ou tlio basis of 
the national norms. In comparison with the norms for the Detroit Exam- 
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ination the median and mean scores were above average on all of the aub- 
testa and also for the total score on the test. The lowest mean score was 
achieved on the tests which were designed to measure Mechanical Infor¬ 
mation and the highest score on the tests for Motor Ability, The mean 
score for Part IV, Arithmetic, also was very superior. As indicated by 
Table 2, 72.5 per cent of the women earned superior scores on the mechan¬ 
ical aptitudes tests, and with the exception of but one woman the re¬ 
maining 27,5 per cent earned average scores. This group of women was 
above average in mental ability as well ns in mechanical aptitudes and a 
definite relationship between the scores was evident. 

The suiierior results for this group of women may be due in part to 
the fact tliat tlic norms of the Detroit Examination are based chiefly on 
unselecfced groups of junior high school pupils. However, in no case did 

Table 2 


Hating of 425 University Women on the Detroit Mechanical Aptitudes 
Examinalion EUid the O.S.U. Test 



Hating on Detroit Mechanical Aptitude Teat 

Rating on 

0,S.U. Test 

Inferior 

Below 20%iic 

Average 

20 to aO%ile 

Superior 

80%ile and Above 

Superior 

80%ilc and Above 

0% 

■7% 

15% 

Average 

20 to 80%ile 

.2% 

20% 

65% 

T/iforior 

Below 20%ile 

0% 

6.S% 

2,6% 


the test fail to measure the limit of ability on any of the subtests since 
none of the women earned perfect scores on any of them. 

To study further the relationship between the results on the tests far 
mechanical aptitudes and mental ability, product-moment eorrelations 
were computed between the scores on various testa and subtests. These 
correlations are shown in Table 3. With the exception of the testa for 
mechanical information and motor ability the correlations found are 
higher than those found for most other similar studies in which comparh 
sons were made between mechanical aptitudes and general mental ability. 

Stenquist (8) reports a correlation of ,23 between the Stenquist 
Assembling Tests and a composite score from six verbal intelligence testa 
in a group of 267 seventh and eighth grade boya. The same correlation 
viz. ,23 was found in this study between the subtests for Motor Ability 
and the total 0. S. XJ. Test. The Stenquist Assembling Tests are far 
more mechanical in character than the Detroit tests. They are not of 
the paper and pencil type. They involve the construction of common 
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mccimnicnl ol^jects from Riven parls s\u'h tvs u ii\<mse ttap, door lock, 
clothespin, and bicycle bell. Sinct! u corrclution nf :1‘.) iiulicjitcH ii very 
Blight degree of rcliiLioiisliip SteiKniist wineliKlcs thiiL inccluLiiical aptitude 
seemH to be a special ability. A correlation (»f .I’l wan founrl by Patcison 
(7) (or 100 juaior high school hoys botwceii I. (2.\s ('HtlniiiLcd from soerej? 
on the Otia lutclUgcivee Test luvd live scores ohltiiucd frojit a mechanical 
apfcitiulo battery, coiniJoscd exchisivcly of appartiliiH or iminii)nlaLion 
teats, Por the Minnesota Paitcr Form llounl "Pest, vv'hicli in a i)tip(!r and 
pencil te.st of the ability to Imiicllc .spatial relatioim, and a v(ical)ulary 
test Anastasi (1) obtained a correlation of .07 for 22o male college sLudentg. 

The 0. S. U. Test and the Detroit Kxivminatioii appear to have mote 
in common than the tests in the stvnUB.s jvv.st cited. The higher correla¬ 
tions found may be atbrilmtcd to tlie common inllucncc of the compre- 
hemsion of verbal dircotions, knowledge of words, and general facility 
witli verbal material. This coiicUision kcciils to be supported by the 


Table 3 

Oorr«!alioiia llotwccn Scorca on the Ohio 311110 Univcrsily T(;Ht and the Detroit 
Mecliftniual Aptiludc.s Examination for University Women 


Dcli'oib Mochnnical AptUudes 
Esnminftlion 

Total 

0. S. U. TmL 

PftrtII,0,S.U, 

Analogies 

Pact I, Motor Ability 

.23 ± .032 


Part, II, Visual Imagc.ry 

.42 i .02(i 

.38 i .028 

Part III, Mechanical InfornuUkm 

.00 ± .033 


Part IV, Arilhuietic 

.43 =b .020 

.40 -i: .027 

Total Teat, Mcchanico-l ApllludcH 

.63 ± .024 

,47 ± .024 


relatively high correlations found between certain Hubtosts and the total 
of the Detroit Mechanical Aptitudc.s Exainimition and the total scores 
and Part II, Analogies, of the O. S. U. TesLs. As shown in Tabic 3 the 
conelatLon of the total 0. S. U. Test with Visual Imagery is .42, with 
Avithmetic .43 and with total Mecslvanicnl Aptitude .scores .53, Between 
Visual Imageiy and Analogies ib is .38, Arithmetic and Analogies .40 and 
between the total Detroit test and Analogies it is .47. The authors 
report a correlation of .65 between the Mechanical Aptitudes Examina¬ 
tion and the Detroit Advanced Intelligence Test. 

Part I of the 0. S. U. Test ialargely a mcaHure of vocalnilavy; Part II, 
analogies, was dc.signed to measure a combinution of reasoning ability, 
spelling, capacity for logical associations and knowledge of grammatical 
forms; and Port III i.s primarily a lost of ability to read diflicuU paH.gagcs. 
Part II would seem to have most in common with the Detroit Examina¬ 
tion since little vocabulary ia involved and none of the aubtesta call for 
ability to read difficult passages. 
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The findings from the data presented in the present study tend to 
support Guilford^s (6) conclusion. He states, ^'Strange as it may appear, 
there seein to be no special abilities of speed, learning, musical talent or 
mechanical bent. Musical talent is very complex and so is me¬ 

chanical slcill.” Thus, while the correlations between verbal and nuineri- 
cal tests generally have been found to be low a higher relationship may 
result when both tests involve similar abilities, such as ability to follow 
directions as appears to be the case, to some extent, with certain aubtests 
in the Detroit and Ohio tests, and to an even greater extent between the 
Detroit Advanced Intelligence Test and the Mechanical Aptitudes 
Examination. 

That mechanical aptitudes are a complex of skills and abilities rather 
than a unitary special ability is further indicated in a study of “Sex 
differences in the understanding of mechanical problems" by Bennett and 
Cniikshank (4). They found women slightly superior to men in testa of 
manual performance if dexterity is involved, and men clearly superior in 
tests of mechanical assembly, or if strength a needed. Again, the super¬ 
iority of men wag not bo marked in testa involving perception of spatial 
relations as the Minnesota Paper Form Board or the Minnesota Spatial 
Relations Test. Subtests 2 and 8, designated as tests of motor ability in 
the Detroit Examination, involve dexterity, and subtests 3, 5 and 7 
termed testa of visual imagery depend to some extent on the perception 
of spatial relations. Bennett and Cniikshank (3) state, “Teats which 
require speed and accuracy in simple perceptual discriminations and in 
simple motor tasks show slightly better scores for girls. In testa of 
strength, boys are superior. In more complicated perceptual and spatial 

taska, boys also score higher. -To a large extent there can be no 

doubt that the superiority of boys in teats of mechanical ability is a 
function of our present system where women are ordinarily not expected 
to deal with certain types of mechanical contrivances nor encouraged to 
do so. When it happens, aa it does in a war period, that women are 
called upon to do some of these things, their performances are far more 
creditable than might have been expected." 

Just as an I.Q. derived from one battery of mental tests does not 
signify the same thing necessarily as an I.Q. from another battery so 
the scores resulting from different teats of mechanical ability may be 
indicative of widely varying aptitudes or skills. The results analyzed in 
this study seem to indicate that the mechanical abilities measured by the 
Detroit Mechanical Aptitudes Examination are not dissociated com¬ 
pletely from general college ability aa measured by the 0. S. U, Test when 
the abilities measured are those of university women. 
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Aptitude and Interest Patterns of Art Majors in a 
Liberal Arts College 

Dorothy M. Barrett 
Ilunler College oj Uie City of New York 

Many students in college have difficulty ia choosing a field of special- 
jaation. Often young people who succeed ic electing a field of epecialirar 
tion later change their minds one or even several times. Even when 
they make decisiona and follow through with them, students freciuently 
later regard their choices aa miatakea. Much energy and ability are 
wasted because atuclenta fail to find fields of study and work for which 
their aptitudes and interests suit them. 

Thia paper describes a study, part of a larger project, which was under¬ 
taken with the intention of trying to discover whether or not a group of 
juniors and seniors who were majoring in art in a liberal arts college could 
bo differentiated by means of a battery of teats from a group of juniors 
and seniors majoring in other fields within the same institution. The 
study was undertaken with the assumption that a baltenj of tests would 
be necesaftry to obtain satisfactory predictions inasmuch as success in an 
acadeiDic or occupational field is likely to depend upon a number of 
aptitudes and interests and not upon any single ability. 

If it proved possible to differentiate artmajora from a group of control 
subjects by means of psychological tests, then it was proposed, after 
further checking the results, to use the battery of tests as diagnostic 
measures in advising underclassmen who consider art as a major but who, 
in spite of having been accepted by the art department, still feel uncertain 
about the wisdom of their choice. 

Psychologists who are concerned with the problems of the vocational 
and educational guidance of students in colleges of liberal arts may find 
something helpful in the results of this project. The critical scores 
obtained in this study may not be the best ones for another institution 
becnuBC tlie predictive value of any scores would differ for each institu¬ 
tion, depending upon the curriculum in which the test program is used, 
the number and types of specializations offered, the admission and 
academic standards of the college and the kind of art training given, 
However, a report of the results on those tests which proved useful in 
identifying art majors may prove valuable to other workers faced with 
advisory problems. 
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Subjects 

In rcaponse to a request for volunteers, forty fitudeuts in the art 
major and an equal number of upperclassmen specializing in other fieklB 
took the battei-y of tests. The art majors were students who, ns juniora 
and eeniora, had obtained satisfactory grades in thoir field of specializa¬ 
tion and were quite satisfied with their choice of art as a major. The 
control group represented juniora and aeniors in other majors who also 
expressed satisfaction with their fields of eiicciaUzation. Subjects in 
both groups were interested in tim testa, having been advised that they 
could learn their ecorea at a future date. All atudents were girts, students 
in Hunter College of the City of New York. 

Testa ' 

The teats which were administered to both the art majors and the 
control subjects included Meier's Test of Art Judgment (1940 revision), 
Strong’s Vocational Interest Blank for ‘Women, the Study of Values, 
Series BB of the Revised Minnesota Paper Form Board and the Guil- 
forda’ Prognostic Test for Students in Design.* 

Scores were available for all subjects for the Psychological Examina¬ 
tion of the American Council on Education, administered at the time of 
admiBsion to college. For a considerable number in the group, records 
were available of the acoros on Grccnc’H Michigan Vocabulary Piofilo 
Test which had been administered ahortly after a atudent’a admia.sion. 

Ucaults on Meier Art Jiidgmont Test 

The distribution of test Bcores made by the art majors on the Meier 
Art Judgment Test overlaps morkedly with the diatribiition of acorea for 
the control aubjeota, As a group, however, the students specializing in 
art make higher acorcs than do the control eubjccts, The average score 
for the art majors is 109 while the average for the control group is 103. 
Using Fisher’s t-test for measuring the aignificance of the difference in 
the means of independent small eamplca, t equals 2.C, indicating that the 
diilerence is significant at the 1% level. 

There are other more useful diffcrcncca between the two groups, 
however. A study of the distribution of ungrouped scores resulted in the 
establishment of two critical scores. A minimum score of 99 eliminates 
a fair number of control aubjccta while diacriniiiiaiing against only two 
art majors, A score of 107 and over singles out a coiiaidcrablc proportion 

* The author is indebted to Miss Adelo Linker for nsaiatanco in acoring tho tests and 
to tho Bureau of Educatioual and Vocational Ciuidanec of riunlor Collcgo of Llio City 
oi New York lor sponsoring Hus study. 

’ Guilford, J. P,, and Guilford, B. B. A prognostic tost for students in design, 
/. apvl Patichol, 1031. 15. 335-346. 
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of the art majors wiiile iiicludmg only a small number of the control 
group,- Thus, there arc three significant ranges of scores. 

Each subject in the experiment was classified in one of the three 
ranges of seores, jiceorcliiig to -nrhetlior her score was below 99, from 99 to 
106 inclusive, or 107 and over. Figure 1 sho-ws the results of such a 
classification, The number of control subjects in each range is indicated 
by the figures to tlic left of the line within the bar. The number of art 
majors in the siiine I'angc of scores is represented by the figures to the 
right of tlio line within tho bar. The per cent at the left end of each bar 
ia the porceritagG which the control group represents of the total group 
scoring witliin t)io limits indicated. The per cent at the right of each 


Scores on 
M^icr Art 
JudfementTest 

107-120 


99-106 

0-98 



16^0 


100 &0 60 40 20 0 10 40 60 80 100 

per cent Per cent 

Control 5ub}ectj Art MftJor5 


Fig. 1. Showing how many were control aubjecte and how many were arl majora 
of those stucIcnlH scoring within certain ranges of scores on the Meier Art Judgment 
Test. 


bar is the percentage which the art group represents of the total group 
scoring in that category. 

Reference to Figure 1 indicates that 11 subjects had scores below 99 
on the Meier Art Judgment Test. Of this group having low scores, 82% 
are control aiibjocts and 18% are art majors. Of the subjects having 
scores from 99 to 109 inclusive, 70% are control subjects and 30% are 
art majors. On the other hand, of the subjects "with scores of 107 and 
over, only 22% arc control subjects while 78% are art majors. 

On the basis of this study, any student scoring up to and including 98 
on the Meier Art Judgment Test would have only 18 chances in 100 of 
being a succe.ssful and satisfied ort major in Hunter College. If her 
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score is between 99 and 107, her chances of hcinR an art major in the same 
institution are still only 30 in 100. However, if a stiulent hag n score of 
107 and over, her chances of being nn art major arc more than double, 
then being 78 in 100. 

Results on Vocational Interest Blank for Women 
The usual method to be followed in attcm])tiiig to differentinto be¬ 
tween the two groiips iu this study would be to uk« only tlui ratings for 
Artist on Strong's Vocational Interest Blank for Women, with Llie ex¬ 
pectation that there would be more high ratings for Artist among tho art 
majors than among the subjects of the control group. However, the 
author believed that high scores on occupations other than Artist might 
show either a positive or possibly a negative relationship to success in art. 
In other words, a student with an average rating as nn Artist and no 
higher ratings for other occupations might succeed in art, while a student 


Table 1 

Showing the Dislribulion of RaUngii for Artist on Strong’s 
Vocational Interest Blank for Women 




llntinga 

(or ArLiet 



C 

C+ B- 

B IM- 

A 

All, MftjoTB 

2 

2 2 

7 tt 

IB 

Control Subjects 

0 

0 7 

7 6 

0 


with an average rating as an Artist but a higher rating in one or more 
other occupations might not be a person who would succeed in art, 

Because, then, there was a possibility of finding certain additional 
relationships which might differentiate between the two groups, the 
blanks were machine scored for all occupations. The writer studied 
carefully the distributions of letter grades for the art majors and for the 
control subjects for each of the 17 occupations on the teat. The ratings 
for several of the occupations did differentiate between the two groups. 
It was concluded, however, that the additional dilTcrentiation on the 
basis of the extra scores was insuificient to warrant, for fiitin’e counseling 
services, the expense of the extra scoring required. Tlio rcinaiiiing dis¬ 
cussion, therefore, is limited to a consideration of tlic scores for Artist. 

Tho art majors and the control subjects obtained rather different 
ratings for Artist, The tabulation of the letter I'atings for each group is 
given in Tabic 1. Reference to the table indicates that only six of the 
forty art majors scored D — or leas as Artist while twenty-two of the con¬ 
trol subjects had such Low ratings. Thirty-four of the art majors scored 
B or better, while only eighteen of the control aubjects had such high 
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mtingfl. In other words, high scorea for Artist on the Strong test are 
more often timn not associated with aucccasful specialization in art, 
Figure 2 bIiows that a student’s chances, according to the resuita of 
this study, of being a Hucccssful and satisfied art major are only 21 in 100 
if she has a rating of B - or less. If she rates B, B+ or A, her chances 
of being a satisfactory and satisfied art major become 65 in 100. 

Results on a Study of Values 

Keeping the control and experimental groups separate, a study was 
made of the distributions of the scorea for each value on the Allport and 
Vernon Test. 



100 80 60 40 20 0 20 40 60 80 100 

Per cent Per cenf 

Control Sulyectj Art 


Fio, 2, Sliowinfi liow many were control subjects anti how many were art majors 
of those students scoring within certain ranges of ratings ht Artist on tha VoDatjona 
Interest Blank for Women. 

The art majors and control aubjects, while yielding overlapping dis¬ 
tributions, did nevertheless show certain differences. Both groups had 
very high scores on the Aestlictic scale, but a greater number of the art 
majors scored at the extreme end of the scale than did the control sub¬ 
jects. More control subjects had extremely low sccrea on the Aesthetic 
value than did the art majors. Taking into consideration the relative 
number of art majors aiul control subjects at each end of the scale, a 
score of 46 and over was given a value of -|-2 and a score of 32 or less was 
assigned a weight of ~3, In like fashion, weights were worked out for 
the other values on the test. On the basis of these weights, it was the¬ 
oretically possible to liave a total weighted score for the Study of Values 
varying from -17 to H-12. Actually, the scores varied between -13 
and *1-8. 
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A fiUuly of tlici clihLribiitioiiN of t)io wiMKlilrO kcoix-s hul Lo Hir c.slab- 
liflhmont of ficirtain ci'ificfll .sooroH H’fiicJj l<t hc.L ijji ningcs of 

acorcH tlmt were siKuificiuiL Tlus oxU'iit In wliirh the, exueriniculal and 
control gr(nj})s differc<V is indh'ulod ii\ 1‘iRuvc ‘»b 

A totnl of 25 aUidonts hiul .srorcfH lielwcrii —Id (iiid —2. 01 this 
group, 88% ^vere coiilrfd subjoclH nml only 12%, ^vere art inujur.M. On 
the other hand, iti the grout» having very high .seoren of -1 and ovc‘r, 8G% 
wore art majors and only M% wciai control sahjc.els, Tin' nuddle range 
of scores included more cfiiwd in-fiportioiiK t»f lui. iiinjor.s and eontrol sub¬ 
jects, the exact jjroporLioiw being shown in Figiir<i :i (Tluj (igiiros in¬ 
side the bar again indioate the mimhcr of cases upon wliieli Die [)('-r cent is 
based.) 



100 80 60 40 10 0 10 40 60 80 100 

Per cent- Per cent 

Control 5ubjcct5 Art Mc^ori 


Fig, 3. Showing how many were control aubjccU and how many wcto art majors 
of those atudente scoring within cortnin ranges of tolAl weighted snores fur the Study 
of Values, 

Weighted, scores on the Alliwrt and Vernon Test tliiTcrentiated well 
between the art majova and the control subjeeta. On the liasia of this 
test alone it is possible to give a fair estimate of a sUulent's chances of 
being an art major. The average score for the art majors was -1-2 and 
for the control subjtjcts it was —3. Again using the t for small sample,s, 
we find that the dirference between the averages is siRnifujant at the 1% 
level 

Ileaults on Revised Minnesota Pa})cr Form Board 
Series BB of the Revised Minnesota Paper Form Board was included 
in the battery of tests administered to the subjects on the as 9 um])tion 
that the ability measured might be one of the aptitudes contributing to 
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Bucceasful coinpomtion, M well ng contributing to succesa in such special¬ 
ized courses in the art major as drafting and lettering. 

The control and experimental groupa had rather similar scores on this 
test of spatial relations. The average score for the control aubjects was 
43 and foi- the aid majors wiui 47, n difference which is small but significant 
at the r)% level. As indicated in Figure 4, 70% of the group scoring 
below 41 were control mibjccla, while only 21% of the group were art 
majors. At tiie other on<l of the distribution. 72% of those students 
scoring B1 and over were art major.*) and only 28% were control aubjects. 
The middle range of .scores included approximately half art majors and 
half control Hubjects. 


Scorw on 
Minnesota Paper 
Form Board 

51-60 


41-50 

23-40 


79/0 
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Per cent Per cent 

Control Subjects Art M(yor5 


Fio. 4. Showing how many were control aubjects and how many were art majors 
of those sludcitU who Hcored within certain ranges of bcotcs on the Minnesota Paper 
Form Board. 


Extreme hcoios on the Revised Minnesota Paper Form Board test 
were significant in differentinting between art majors and control aubjects. 
This teat gave results sufficiently diagnostic to be included in a final 
battery of to.st.s. 

Rcsiilta on Other Tests 

The exiierimonial and control groupa had identical Q, L, and Total 
acorc.s on the A. (J. E. pHychological Examination. The two groups did 
differ, liowcver, on the Michigan Vocabulary Profile Test. Analysis of 
the profile Hcores made by the studentH when they were freshmen indi- 
catca that for the Fine ArLs Vocabulary section the average score for the 
students who later became art majors was higher than the average score 
of those students who later majored in other fields. Because scores were 
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not available for all subjects, however, the test was not included as one 
of the predictive measures in the final battery of tests. 

The Guilforda' Line Drawing Teat, which was inchidod in the experi¬ 
ment, brought out some interesting dillcrencca between the two groups. 
The test appeared to measure n certain creative ability which the other 
tests did not touch. However, the subjectivity of tlie scoring of the teat 
proved too great an objection to its use in practical circumstances. 

Eesults of Four Teats Combined 

The scores from Meier's Test of Art Judgment, Strong’s Vocational 
Interest Blank for Women, the Study of Values and the Revised Minne¬ 
sota Paper Form Board were weighted in terms of the extent to which 
each test differentiated between art majors and control subjects. When 
the scores were combined, the results were strikingly satisfactory. 

The combined weighted scores ranged from —20 to H-18. Dividing 
the siibjecta into two groups on the basis of whether a given score was 
below zero on tlic one hand, or zero or above on tlic oilier Imnd, wc find 
that the control sulijects are separated from the art majors with 85% 
accuracy. The actual number of art majors and control subjects within 
each scoring range is indicated in Table 2. 


Table 2 

Showing the Diatribution of Total Weighted 
Scores for Test DaLtcry 


Total Wciglitcd Scores 

-20to-l 

0 to -1-18 

Art Majors 4 

30 

Control Subjects 32 

8 


Ordinarily, psychological teats pick out the failures more readily 
than the successes. A minimum score is often necessary for success. 
Not as often does a liigh score mean success. The tests used in this 
study have, however, tended to identify the art majors in positive fashion 
as well as to identify those students least likely to possess such a pattern 
of aptitude and interest. 

It should be pointed out that some of the scores made by the art 
majors may be spuriously high. It is possible that the score.s on the test 
of Art Judgment and on the Revised Minnesota Pajicr Form Board may 
be higher than would ordinarily be the ca.se just bccau.se the students 
have been studying art. To what extent the diffcrenccg established in 
this study would be substantiated if subjects were given all tests at the 
beginning of their college courses is at present a matter of conjecture. 
The author is carrying out a study to check on this point. 
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Meanwhile, however, the distribution of the combined scores war¬ 
rants further consideration. According to the results indicated in 
Figure 5, no art majors were included among the eighteen students having 
the lowest scoies, the tests thus predicting 100% accurately for this 
range of scores. Eighty-five per cent of those subjects having high 
scores were art majors, a very satisfactory degree of differentiation be¬ 
tween the two groups. 

A study of the five control subjects included in the range of scores 
which was generally typical of art majors leads the writer to wonder if 
the tests may not be even more successful than the figures have indicated. 
Reference to interview notes jotted down at the time the subjects took 



100 80 60 AO 10 0 10, 40 60 80 100 

Per cent Per cent 

Control Subjects Art M^ors 


Tig. 5. Showing how many were control aubjecta and how many were art majors 
of those students scoring within cerbwn ranges of oomposite weighted scores on the 
test battery, 

the tests or reported for their scores shows that one control subject who 
scored high on the battery of tests was an art major originally, but 
changed to another field because of a personal experience which had turned 
her against the study of art. It seems fair to conclude that she had 
reacted against personalities and not against art as a major. This girl 
was evidently not a fair control subject if what ws are trying to predict 
is interest and ability in the field of art. 

Another control subject just recently discovered a flair for art, She 
is continuing her present major but has decided to include as many art 
courses as possible in her program, Very probably she would have made 
a satisfftctoi'y art major if she had become aware of her aptitudes and 
interests earlier. 






492 


Dorothy M. Darrctl 


A careful study of the aptitude nnd intcroat pnttern.s of Hcvcrnl of the 
Evrt Btudenta who fell outside of their Rroup tm the Iulhih of the totM 
weighted scores on tliia l)ftttory of tests leiuls the iinthor to conclude that 
although the sludcntu arc satisfied with their inajruH, tliey might have 
done better work and l)cen bettor fiftlisfinil in other fields. For example, 
one art major scornH to have a flair for science, a fuel wliich slie never 
and never (elUwed up. It in \i«ssilil(*. that it is sigulheant that 
this student had scores more similar to the scoreH of the control Biibjcctg 
than to tliG scores of the art majorfl. 

In conclusion, then, it can be ntated that tlic total weighted scores on 
this battery of tests differentinted dearly hetwepn the art majors nnd the 
control group. The difference Irclwccu the averages of the two groups 
for the total weighted score is significant at the 1% level. 

Summary 

1. A battery of test,? which included Moier’s To.nt of Art Judgment, 
Strong's Vocational latcreat Blank for Women, the vStudy of Values and 
tho Revised Minnesota Paper Form Board {lifTcrentiatcd between a 
group of 40 art majors and a group of 40 control subjects with 85% ac¬ 
curacy. Critical score.s estoblwhcd for cncli lost made it po.s.sible to 
combine the re.guUs of tlic four tests and tlicn to predict wiili only a small 
margin of error a student’a likelihood of being an art major in tho curricu¬ 
lum of Hunter College of the City of New York. 

2. Other teats studied but not included in the final battery of teats 
included Greene’s Michigan Vocabulary Profile Teat, the Guilfords’ 
Prognostic Teat for Students in Design and the A. 0. K. Psychological 
Examination. 

3, No differoncea were found between tho control and experimental 
groups for either the Q, L, or Total scorca on tho Psychological Examina¬ 
tion. On the Michigan Vocabulary Profile Test, wliich had been ad¬ 
ministered to many of the students at the time of their entrance to college, 
the art majors ranked higher than, the control aubjccte on. the Fine Arts 
Vocabulary section. Because scores were not available, liowever, for all 
80 subjects, the test was not included in tho final battery of tests for 
which a weighted total was obtained. 

4, The Guilfords' Line Drawing Test was administered to nil sub¬ 
jects. A kind of creative ability Bccmcd evident in the data, auggesting 
interesting possibilities for further annlyms. However, evaluation of tho 
recorda for this test ia too subjective at tliis stage to warrant tho inolusiop 
of the test in a battery of testa for immediate practical use, 

Received November U, 19U< 



Merit Examination Cut-Offs and Weights 

Wm. Thos. Tool an 

Snvcrvim of kecruitmenl, Los Angeles City Board of Education 

Although tliQ Merit System haa made much progress during the last 
few years, it still faces the problem of shaking off some of its inheritances 
such as setting weights and passing marks in advance of examinations, 
and making cut-offs without careful study. Some public personnel 
agencies are compelled to arbitrarily set weights ahead of examinations 
because of the limitations imposed upon them by the laws under which 
they operate; other agencies accept this sort of procedure because others 
use it. The procedures set forth in tliis article will be found to be fairly 
objective because of the use of simple analysis and study of parts of exam¬ 
inations and their relation to each other. 

A "cut-off/' for the purpose of this article, ia a line on a frequency 
distribution of scores below which scores are considered aa not acceptable 
or are below a predetermined standard. The lower tail of the distribu¬ 
tion is usually cut off. The upper tail represents persons supposedly 
"too good" for the particular job. This upper tail is not considered when 
making cut-offs in public service. 

The reason for these eliminations ia not always understood by the job 
seeker. Mo.st of them feel that they are qualified and therefore should 
be on the employment list. The recruitment office, of course, has defi¬ 
nite reasons for making an elimination after each part of an examination, 
and just before the eligible list is established. 

Applicants are not always told the real reason why their names do not 
appear on the list. They arc often told that "the size of the list did not 
warrant placing their names upon it." This would imply that “the size 
of the list ia based on our anticipated needs." No matter how a notifica¬ 
tion of standing, that tells the applicant his name is not on the Hat, ia 
worded, it means to him that he has failed in the examination. This 
generally makc.s for ill feeling with the public, 

Elimination at each atep of the examination ia ordinarily done for the 
purpose of getting rid of unfit applicants. The final elimination should 
be made on the basis of including all qualified applicanta, That is, no 
matter what the needs or anticipated needs might be, all qualified ap¬ 
plicants should appear on the eligible list. The excuse of the recruitment 
or assignment office that it entails some additional clerical work hardly 
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aeems sufficient. For the sake of public relations, it is well that elimina¬ 
tion of applicants seeking jobs in the public service be done more carefully 
and scientifically than heretofore. 

Before starting to make a cut-off, it would seem that a knowledge of 
what had taken place to give ur these scores in the distribution would be 
a sine gua non. If we have not formulated the apeoificatious, drawn up 
the test, administered or analyzed it, wc should got in touch with those 
who have done so. We arc now qualified to take the firat step in. making 
tlie cut-off. This tentative cut-off will he a guess, backed uj) ])y the sup¬ 
porting data which we have at band. 

A Tentative Cut-Off 

Around, or somewhat above and below this tentative cut-off, will be 
found test papers none of which are exactly alike. If the test is a written 
one or a practicol (performance), the results for each candidate will be 
different although they may have the same score. One will have missed 
items which the other or others will have gotten right, If we have made 
too low a cut-off, wc will be in the midst of a lot of poor papers, If we 
have made too high a cut-off, the papers will, generally speaking, be 
quite acceptable. Thus, we may have to move up or down and make 
several test cut-offs before we arrive at a place where we are fairly sure 
that wc have neither done any gi*eat injustice nor included any obviously 
unfit papers. 

If there ate many vacancies or anticipated vacancies and there is a 
dearth of applicants, we may be forced to include more above the cut-off 
than wc would otherwise. Or, if there are few vacancies, or anticipated 
vacancies, we will probably not wont to carry an excessive number 
through the remaining pai’ts of the examination. There ia great danger 
in picking up the unqualified when making a low cut-off, and there is 
danger in building ill feeling by failing a large group of qualified persona 
when making an unnecessarily high cut-off. 

A Typical Example 

What one runs into can be seen by examining a group of practical 
papers for say stonographera. . Among some obviously unfit papers is 
found a paper which on close oxaminntion shows that the contestant did 
very poorly at the beginning of the test and gradually got better toward 
the end in spite of the fact that there was an increase in words per minute. 
This was not due to lack of “warm-up” as wc find that ample practice 
dictation was given prior to taking tlie test. To those who are experi¬ 
enced in giving stenographic tests, tliiso thoughts would immediately 
come to mind: Taking insliorthand. and transcribing are different steps. 
The longer the test, the greater the possibility of the first part of the notes 
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getting cold. The testee who lacks a vocabulary of sign words or lacks 
retention will not be able to read much of the first part of her notes be- 
causQ they are colder. No matter how fast one can take shorthand, if 
she cannot transcribe or read her notes when they are cold, they are of 
little value to anyone. 

Many limitations are imposed on one who is attempting to make a 
scientific cut-off for a practical test. It is impossible to assume a purely 
objective attitude. Persons scoring typing or stenographic tests do not 
rate exactly the same. Testees often make the same eri’or but under 
different circumstances. One stenographic testee omits five words of 
dictation and patching it up submits an acceptable letter, another makes 
the same error but makes no attempt to “fill in.“ They are penalized 
alike. 

Although approximately the same modus operandi may be used in 
making cut-offs, no two are made in exactly the same manner. The 
more we study the peculiarities of the papers, whether written or practical, 
the more we are in doubt regarding the maimer in which this or that 
answer was chosen in an item of a written test, or just why this otherwise 
good practical test was spoiled by the testee doing something unusual or 
out of the ordinary. 

Ordinarily an examination includes a \yritten and an oral part. 
Sometimes a practical test follows the written, and occasionally a practi¬ 
cal and oral is used. This last combination is used where the practical 
is broad enough to test for the degree of skill needed for the job. How¬ 
ever, where it is necessary to test for technical knowledge, a written test 
is used. The oral test is ordinarily used as a test of general fitness for the 
job. It includes evaluation of personal characteristics, and education 
and experience. 

When Parts Should be Weighted 

The weighting of parts of an examination before it ia held can hardly 
be anything other than an estimate of the results of the examination. 
For instance, the written is compiled and intended to test for certain 
things, but after it ia administered, and the results thereof studied, it ia 
found that it has failed to come up to expectations, The distribution of 
scores may show clearly that it is too easy or too difficult for the group. 
This would, then, make a difference in the weight assigned it, Ineffective 
rating on the part of oral or practical teat raters should be cause for 
lowering the weights of these parts, whereas otherwise they would be 
assigned higher weights. 

Where an agency uses the same written and other parts of an exam¬ 
ination, and the same rater requirements, and the quality of the applicants 
remain the same, about the same results can be expected. This being 
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the case tentative weighta may be set subjeet to study after all jjarts of 
the examination have been completocl. 

The weight of an examination part will vary when studied in the light 
of the requirements for the job. Exnmi)Ias of extronuiH, say for personal 
chnracteristica requirements, would be "ficcrctary'' and "billing machine 
operator." Although studies liavc shown that the majority of emjjloyccs 
are unsatisfactory because of personal eharacteristics, wo must admit 
that the degree to whicli personal chamctcristics arc iinjiortant will vary 
with the job. Thus weights for the parts of an c.\ainiiuiLiou will depend 
upon the nature of the position for which the examination is given. 

The question us to the cffcclivcneas of a part in an examination prob¬ 
ably is the least objective step in determining Us weight, All coiusidora- 
tions of the examination are kept in mind and the paired comi^arison 
method of ranking employed. In other words, this j)l»asc of the study 
presupposes a thorough knowledge of all that has any bearing or throws 
any light on the examinations. It is backed up by ai)pliealjle informa¬ 
tion, or supporting evidoncG. 

If the written test boa been administered and studied as to reliability, 
it can be relied upon to give about the same results each time it is used, 
provided the requirements for admission to the te.Hl Iiavc not been changed 
materially. The practical is proluihly the easiest of all tlie jjarts of an 
examination to size up as to its c0cctivenc3S, <lcj)ending, of course, upon 
tlie raters, the nature of tlie test, how elaborate it is, etc. In all parts of 
an examination, with tlie exception of the written, evaluation of effective¬ 
ness is based on observation, and, of course, distribution of scores. 

As soon aa we affix a weight to a part of an examination we indicate 
that it ha.s been considered in relation to the other part or parts of the 
examination. Its importance or effectiveness, then, is reflected in the 
weight assigned it. When an attempt ia made to consider a part without 
first considering the other parts, the other parts may be left with too 
small or too large weights. That is to aay, if we insist that written parts 
have low weights affixed to them, we are apt to find that the oral inter¬ 
view parts have been given excessive weights. 

What Weights Do 

If a part of an examination is important or effective, it should be 
weighted accordingly. When a part has proven itself worthy of the 
heaviest weight in an examination, and such n weiglit has been assigned 
it, it becomes the controlling factor of the relative placement of poi'sons 
in the final distribution, or the eligible list. Thus ilio greate.sL weight in 
an examination will tend to move persona on the final distribution a 
greater number of places than will the amallcst weight assigned. Wliat 
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weights will do can be brought home most effectively by reversing as¬ 
signed weights and observing the results. 

Frequency distributions of parts of exarainationa vary to the extent 
that no two are idoniical. This jneans, thenj that their spreads and 
“forms” are instrumental in shaping final distributions and eligible 
lists. A distribution of a part which has a tendency to be bunched 
(skewed) upward or downward or for any reason does not have a good 
spread of scores has set a comparatively low weight for its part, and should 
be weighted accordingly irrespective of what weight hoa previously been 
forecast for it. 

The setting of weights for examinatioi^ in other than a careful man¬ 
ner is apt to spoil everything that has gone before. Such a pnon methods 
as are sometimes used because of carelessness or ignorance of a few simple 
rules, are not in accordance with the merit system because they have a 
tendency to place persons on eligible lists out of the order of their relative 
excellence. This is true of any procedure which is not done in the 
manner in which it should be done. The results not being apparent to 
the layman he docs not challenge the methods employed. 


Received October 12, Id^. 
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RosenstDin, J, L. The ficientific seledivti of snUmcn. Now York: 

McGmw-riili, 1944. Pp. xii -h 2r)9. 

The audience lor, and major ol)jcclivc of, lliis Ijook is wtiitod aa follows 
by tlie nuLhor; “This book is for sales cSecuUvcs who me loiiK-range 
minded. Its purpose is to describe, to explain, mid to tench the sLejia in 
a scientific salesman selection program" (ix). For many reasons the 
publication fails by a wide margin to meet cither the needs of its intended 
audience or its primary objectives. 

Throughout the book there arc evidences of hasty, supeificial writing. 
Important concept.? arc ignored or treated .so sketchily that they might 
better have been ignored. On the other hand, certain simjile ideas, such 
aa the computation of an average, arc heavily labored. Part of the 
difficulty encountered by the author arises from his attenpit to over¬ 
simplify psychological tools and tcchnique.s which just cannot be so 
treated for lay readers. An example of this is the attempt to Loach inter¬ 
pretation of complex psychographs to laymen in fewer than forty [iiiges 
(211-244), In the section on interviewing, aiich Icrms as “Hub.sbitution,'' 
"persecution,” and “piojcction” arc introduced with little cxi)lanation 
for naive readci’s, 

Treatment of tD.sts and testing is entirely in/nloqiiate, Two cpjota- 
tions suffice to indicate the general approach to inctisui'cincnt, 

“Do not be troubled al30ut the matter of ndmiiiiatering tests. The 
instructions for each test are eiinple and, if followed carefully, should 
present no difficulty" (169). . . .“Tests fur Basic Inlmsls. For an in¬ 
vestigation into the kinds of iictivitie.9 in which an individual is interested, 
one of the best known tests is the Preference llecord, by G. Frcdciic 
Kuder. 

“Preferences will certainly be exhibited in tlic degree of entliiisuism 
with wliicli an individual enters into various activities. It may be wise 
to learn the preferences displayed by your successful salcsm(!n as com¬ 
pared with those \Yho fail" (167-68). This lust quotation is the coinpiete 
information given the reader about a test whkdi is rcconimciuled for a 
selection battery! 

Sections of the book are devoted to the api)licaLion blank, and selection 
of salesmen for small companies. Materials coneeriicd with the aij])lica- 
tion blank are the strongest point in tlic publication. Even in this section 
much of importance is ignored. Readers who wish to read further about 
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topics which interest them will be irritated by the author’s failure to 
include sources. The names of writers and researchers are referred to, 
but the publications and publishers are omitted. 

In the opinion of the reviewer, this is a poor book on a topic which is 
deserving of much better treatment. 

_ Milton E. Hahn 

Syracuse Univemly 

Traxlei, Arthur E. Techniques of guidance: Tests, records, and counseling 

in a guidance 'program. New York: Harper & Brothers, 1945. Pp. 

xiv + 394. 83.50. 

The first thirty or forty pages of this compact volume may give the 
reader, sophisticated or otherwise, some blank misgivings, But if he 
persists, his patience will be richly rewarded. Few books that have come 
to my attention in recent years have been more appropriately titled or 
more effective in their progression. From a conventional beginning that 
toys with definition, staff organization, and costs, the science of guidance 
gradually becomes the art of bringing into conjunction to their mutual 
advantage the potentialities of pupils and the resources of school and 
community. 

School and community resources are treated rather generally but with 
ample reference to sources of information. Understandably the curricu¬ 
lum, which is the school’s chief formalized resource, is neither described 
nor challenged; but the growth of the extracumculum is given subtle but 
effective emphasis as a promising adjunct to readin’, writin', and 'rith 
metic. 

If facts are the beginning of wisdom, then facts about the pupil—as a 
learner, a personality, and a social being—are the sine qua non of guidance. 
Kinds of appropriate facts are outlined: home background, school history, 
mental ability, achievement and growth in fields of study, health, out-of- 
school experience, interests, special aptitudes, personality, and plans for 
the future. Use of the questionnaire and the interview is discussed and 
their values and limitations highlighted. 

Tests as instruments of fact finding, however, are given the largest 
amount of space and the most exhaustive treatment. Aptitude as a 
concept is intelligently discussed, and likewise the fact of individual 
differences; but without any attempt at explaining the why. A selected 
but reasonably exhaustive list of tests carefully and fully annotated is 
attached, incltiding titles, authors, publishers, research information and 
references. 

An even more extensive array of achievement tests is described with 
equal fidelity to fact. These fall mainly within the areas of reading. 
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geacral achievement, English, foreign language, nmtlicinaties, science, 
and the social studies. 

Appraisal of personality is treated under two heiidiiigH: (1) tests, with 
a rather extensive annotated list included, and (2) anecdotal records and 
behavior descriptions accompanied with diKeUH.sk)nH of the values and 
pitfalls of both testa and records or dcscriptiona. 

planning and administering a testing progritin an<l scoring, organi'/sing, 
and reporting test results arc fully and effectively treated willi concrete 
suggestions drawn from actual practice huttreasing tlio general discussion, 

A variety of services and possible cooperative ventures are pointed out for 
schools not fully equipped to engineer a program without outside help. 

The possible uses of test results point up flhar|)ly the tremendous lag 
between test constrviction and test-giving ou the one hand, and on the 
otliei’, what is done about all tliis fury of activity. With infinite patience 
Dr, Traxler dcscribeg the instructional uses of tests. He elaborates them 
so fully and with such reasoned precision that he may feci, as many 
readers will, that he has argued his case perceptibly beyond the point of 
diminishing returns. Administrative uae.s of test rosult.s, and by infer¬ 
ence, their possible effect upon the curriculum, are it appears "outside 
the acope” of his book. 

Within the conventional setting of school resources, counseliug uses 
of test results are recommended to identify individual weaknesses of 
pupils, to discover special abilities, and as a basis for conferences on be¬ 
havior adjustments, course sequences, vocational and educational plan¬ 
ning. But tests are only one element in the total guidance program. 

"A comprehensive and detailed system of cumulative personnel re¬ 
cords is indispensable for the proper functioning of the modern school." 
Some eighty pages of text and sample forma arc devoted to the cvimulatWe 
record and reporting devices and to dependence on facts of status and 
progress for immediate or ultimate attainment of desirable educational 
or career objectives. The ideal is admirable and convincingly presented 
as within the realm of the attainable. Comparability of test data is pro¬ 
jected ag essential. Adequate and systematically planned assembling 
and recording of other kinds of data are stressed as equally important. 
If both kinds of information are to bo significantly useful, they must take 
their origin not from teats and records as such but from "a stiidy of the 
nature and purposes of the school and of the pupil.” Useful, practical 
suggestions are given for filing and accessibility of materials. 

"The whole thesis of this book, however, is that counselors who are 
not psychologists are entirely capable of performing the distributive 
functions of guidance and many of the fess involved adjuslive functions, 
provided they will get acquainted with and use the techniques for know¬ 
ing individuals." To this end lista of references, not exhaustive, but 
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well chosen, have been appended to each chapterj and the final chaptei- 
consists of reading resources for counselors. For those who have the 
urge to learn their students as well as teach them, Dr. Traxler’s volume 
holds out great iiromise. For those who are professionals in the field of 
guidance, the volume is an excellent handbook. 

F S BepM 

Social Secnrily Hoard, 

WashiTiffloii, }}. C. 


Scott, Dorothy D., Morgan, Winona L., and Lehman, Ruth T. De- 
\}elo'pin{} a studeni guidance progmw in an instructional dcparlmeni. 
The Bureau of Kduc-ational Research, Ohio State University, 1945. 
65 pages. 

The monograjdi describes the procedures used for the past several 
years in the School of Home Economics at Ohio State University in an 
attempt to provide more adequate student guidance and to determine 
technicpics useful to the teacher counselor. The plan was inaugurated 
because it had been found that many students graduated without any 
faculty member really knowing them, and many made unsatisfactory 
vocational choices. 

The sLalT accejitcd the idea that colleges siiould be concerned for the 
all-round development of the students, that the guidance point of view 
should permcatG student-faculty relations, and that the college staff can 
beat acquire thi.a through participating in a guidance program, 

Responsibility for guidance is divided among three groups. The two 
coordinators are chiefly concerned with administration although they do 
some counseling and teaching; the general advisers letain the same ad¬ 
visees throughout their four yeara in college, hold planned conferences 
with each of them (and additional conferences upon request) to analyze 
(the students^ progress, plan next steps, and suggest resourcea for their 
personal development; and the professional advisers plan policies for 
selecting students, provide group guidance on professional problems and 
assist in placement. Most faculty members serve as general advisers 
and the heads of departments as professional advisers. 

Individual Counseling. Each conference with the general adviser is 
planned with a specific purpose, although plana may be altered if desired. 
The chief idea is to help students and faculty to get acquainted and to put 
students in touch with sources of special help which may be needed, such 
as the Health Service, the Employment Service, and the Psychological 
Clinic. The firal conference is held during Freshman Week, the second 
in the spring. The sophomore conference comes in the middle of the 
year and is planned to offer help in making a vocational choice. The 
last planned conference is arranged for the fall of the junior year and at 
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that time students are liclpecl to analyze what Ims been nceompliahed 
during the first two years and what aliould be planned for in the last two 
in order to get the maximum out of college. Students may initiate 
conferences during the senior year as they may during the preceding 
years, but no definite conference is scheduled. Informal entertaining of 
small groups in her office or at the adviser's home provides a very worth 
while type of contact, 

Transfers are assigned to advisers when they enter and they furnish 
much of the same personnel information which tlic frc.shmon do. 

Group Guidance. Several types of group guidance arc offered. The 
Freshman Orientation course which is required of all entering freshmen, 
meets three times a week, and carries two credits. Tire course includes 
small group discussions for 30 or 40 students, counseling by instructors 
and selected older students, collection of personnel information, and ad- 
miniatiation of most of the teats used. Professional guidanco is given 
through meetings sponsored by professional advisers—somctime.s for 
those specializing in the department and sometimes open to all students. 
Discussion of pertinent material, student participation in the i)rogrnm, 
and recognition on the part of the students of the need for the information 
probably explain the high attendance at these meetings. 

The Guidance 0,ffice is under the direction of the coordinators and 
handles much of the routine work of the program, such as providing 
advisers with all needed forms, keeping confidential folders up to date, 
and administering tests. The coordinators take cl\arge of scheduling 
laboratories for underclass students and the professional advisers of those 
for upperclass students, and in these, students work out their schedules 
and can obtain individual assistance if it is needed, 

Rating of students is done by staff members with a relatively simple 
form and provision is also made for recording any comments instructors 
wish to make about the student. Ratings arc given on only those points 
for which the instructor believes she has a basis for judgment and students 
are allowed to see their ratings when an adviser is available to help them 
interpret them. Careful self-evaluation is provided for at several stages. 

The appendix includes copies of all of the forms used in the guidance 
program, an outline of the orientation course, and an annotated list of the 
testa and inventories used, 

Clara M, Brown 

UniveirdUy of Minnesota 

Klein, D. B. Mental hygiene, the psycliology of personal adjusbment. 

Henry Holt, 1944, xiii + 489. 

Mental hygiene has reached the stage where specialists in the field 
should be factual, critical, and systematic. In the first major section of 
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the text, Dr. Klein fulfills excellently his preface promise to meet these 
criteria. Here, he discusses in some detail with documentation an ob¬ 
jective and eclectic view of the psychoses and paychoneuroses and the 
prophylaxis pertinent to each of them. The author's second division of 
the field, called by him ‘‘Promotion of Mental Health,” is presented in the 
form of loosely connected essays, mostly on important but selected topics. 
The home, conscience, motivation, coping with reality, repression, econo¬ 
mic barriers, and education are the subjects of the chapters of this section. 
Despite the fact that there is a voluminous literature on parent-child 
relationships, only two references appear in the entire chapter on the 
home. The chapter on education deals with selected important problems 
but the reader may leave it without realizing the extensive factors in 
education affecting morale. The influences of the playground, athletics, 
cliques, and other extracurricular events, for example, are omitted. 

The author warns that he will restrict himself “to the confines of 
mental hygiene territory.” This apparently explains the omission of a 
concise preliminary review of basic psychological concepts as motivation, 
adjustment, conditioning, inhibition, symbolism, etc., and fuhdamenttlls 
in a theory of personality. It does not explain why psychoses and psy¬ 
choneuroses are given a disproportionate emphasis at the expense of 
juvenile delinquency, child and adolescent personality and ‘behavior 
problems and psychosomatic difficulties. 

Dr. I^Iein'a book makes certain distinct contributions to the field. The 
discussion of specific prophylaxis for each mental abnormality ia an 
example, The forceful chapter devoted to the economic and social 
aspects of mental hygiene reminds us that there are factors of social 
control in mental health which are outside of the influence of individual 
psychologists or psychiatrists. The recent periodical literature is related 
to a discussion of basic theoretical problems, such as the distribution of 
mental illness, the extent to which it is constitutional or the result of 
conflict, the implication of the animal studies and the meliorative and 
prophylatio roles of the hygienist. These are a reminder that too much 
has been written in this field without first examining basic premises, as 
Dr. Klein did. 

The task of meliorative mental hygiene as the author sees it is to 
develop a philosophy of life and high morale. This is not achieved, he 
stresses, through an array of mental hygiene maxims or drills, This 
emphasis is a good antidote for some kinds of pseudo mental hygiene. 
It is congruent with the prevalent non-directive trend in psychotherapy. 
However, discussion of specific problems and techniques as a means of 
eliciting insights and building attitudes in youth can be achieved by a 
skillful presentation without Jeopardizing the reader's self direction or 
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indepenclcncG of action. This reviewer hclicveH Dr. Klein could have 
strengthened his book pcdagogically Ky Ki-oater use of this specific ap¬ 
proach. The undcrelnssinan, however, sliould find the text readable, 
stimulating to insights, tnul socially progressive. 

Fred McKinney 

UniveraHu oj Missouri 

Bowlcy, Agatha II. Guiding the norinal chiUL Now York: Philosophical 

Library, 1943. Pp. xv + 174. 83.00. 

This book whicli is tuldrosHed to iwirents, toachers, social wnrker.s, and 
physicians contains many practical HUg^stions for dealing with behavior 
and adjustment i)roblem8 of children. Its autlntr, who is a lecturer in 
the teachers’ braining college at Dundee, Scotland, lias Imd wide experi¬ 
ence with nursery schools and ns a psychologist in the Dundee Child 
Guidance Clinic. 

Beginning with nn nccotint of the child’s <ievelupineiit during infancy, 
the treatment carries forward to the end of the lulolcscent period. The 
specific chapter titles are Infancy, The Pre-School Period, Difficulties 
During the Pre-School Period, The Middle Yeans of Childhood, Dilllcul- 
ties During the Middle Years of Childhood, AdolcHecncc—Development 
and Difficulties, and Children and the War. 

The volume ia oxceptioually easy reading and contains nuniorous short 
case studies which adds to its interest. It is decidedly not a typical 
textbook on child p.sychology, and probably should not be u.sed for this 
purpose. It would, however, provide excellent suppleinciitary reading in 
connection with a course in child psychology. It is distinctly a “how” 
book. 

For the most part the suggestions it gives for child guidance appear to 
be based upon a sound psychology of learning and adjustment. Oc¬ 
casionally, however, the author propounds a theory or takes a position 
which seems at variance with the beat current thought in America. For 
example, in discussing fears of the pre-school child, she says: “These fears 
are largely the result of unconscious feelings of badne.ss, and may be 
termed aTi^ieties. . . . He may fear that his parents may desert or harm 
or starve him if he is unworthy and unlovable because he sometimes har¬ 
bours bad, hateful feelings towards them. If ho feels so to them they 
may reciprocate and retaliate. . . . This would seem to bo at the root of 
the phobias of the pre-school child which are so very eommon. D^mr.s of 
clogs, cats and spiders, for instance, frequently re])resenL a inojeetion of 
those nnconacious fours on to some object in the external world against 
which he may enlist protection" (p. 63). In other words, the child may 
be afraid of dogs or cats not because of previous unpleasant experiences 
with them, but because he has nn unconscious fear of his parents. With 
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respect to the development of intellectual traits, the author has a strong 
heteditarianbias. She aaya: “The dull duld is dull by virtue of hia poor 
mental inheritance. It ia important to recognize his degree of dullness, 
to assess his mental age and so plan a curriculum that suits him and en¬ 
sures that his needs are satisfied" (p. 92). In view of recent findings 
with regard to the constancy of the IQ, this seems to be a rather strong 
statement. Her definition of adolescence as being "that period between 
13 and 18 years for boys, and 12 and 16 years for girls" (p* 131) would not 
generally be accepted as valid in this country. Our boys and girls seldom 
achieve social maturity or become weaned from their families at such 
early ages. 

Despite these minor criticisms, the book has very much to commend 
it. It is functional, and highly suggestive with respect to child guidance 
procedures. The chapter on Children and the War is particularly timely 
and valuable. Dr. Bowley’s book can be read with profit by anyone who 
desires a straightforward, simple, and dynamic explanation of child 
behavior problems and methods of dealing with them. 

Glenn Myers Blair 

University of Illinois 
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testing. The second problem is a matter for mere arbitrary 
agreement among qualified psychologists. If it is agreed that 
in the total intelligence score the attention test is to have a 
value of one third or some other value, well and good, But in 
the end we will have an agreed-upon series of tests measuring 
an agreed-upon ability or group of abilities. 

One may well pause to wonder whether the teim "intelli¬ 
gence” as it is now (apparently) used is of any value to psychol¬ 
ogy. At present one’s intelligence is merely a relative ranking 
0 ]i a battery of tests of the higher central processes. As such it 
repiesenta a summation of the scores made upon the various 
component testa in the system. At best it is a sort of abstrac¬ 
tion or "average” intellectual level. A psychograph, repre¬ 
senting an individual’s levels on the various tests, would bo much 
more elucidating than an intelligence score which merely hides 
relative strength and weakness in the component abilities. 

VAiiious "kinds” of intellioences 

Again taking their cue from sociology and practical life some 
psychologists have suggested and introduced various "kinds” 
of intelligence. Thorndike has advocated these various species 
of intelligence as a logical outcome of his view that intelligence 
is but a bundle of specific and independent capacities, But it 
appears merely to add more confusion to an already sufficient 
confusion. If we speak of absti’acfc, concrete, manual, and social 
intelligence then by virtue of the fact that we use intelligence 
throughout it is suggested that there is an intelligence common 
to all forms of activity. The thing then works very nicely 
over into Spearman’s common factor view. Would it not 
clarify matters if we spoke of just one kind of intelligence, 
possessed in different degrees by diffei’ent people, and proceed 
to define intelligence in agreed-upon payohological processes? 
It would not be necessary to know the ultimate nature of 
intelligence, 
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EFFICIENCT RIGHT NOW V15U3U.S '^CAVACITV" 

Any test measures what the subject can do vi^ht now, just 
fis lie is at this moment and under the extcrnnl ciroumstancGs 
which are pieaent. We may call this "present ofllclcncy." 
Eut is it noccssEU'iLy the man's "cnimcity?" Cainvcvly should 
mean just wlmt the tenn implies, namely, llic person's ability 
under the optimum conditions for that orgnnisin. Capacity 
is appavcutly being used in two different acusefl, one of which 
should be entirely droiTpcd or else very clearly defined. A 
person's true capacity could be measured only when that capac¬ 
ity Ima reached its maximum maturation and practice. Tlie 
intensity of effort and interest must bcmaximalj to say nothing 
of the many other favorable external and internal conditions 
which would bo pre-supposed. Capacity is, at best, an in¬ 
ferred thing and its inference is fraught with much chauco for 
unfairness. 

Perhaps it would be well to Bpoalc of measuring one's “efii- 
cicncy'^ when we arc seeking a person's demonstrable capacity 
aa it reveals itself at the time of the testing, The tenn "effi- 
cJGEcy’ ’ would then mean merely what fcho subject was nlilc to do 
at that time. It would have no implications beyond this. 
The term "capacity” could then be used to signify what the 
person mighl do if his training, attitude, and physical condition, 
were most fattomhle for the most complete development of the 
given capacity or ability. A child reveals au intelligence 
quotient of, say, 100 on the Stanford Binet testa. Later on 
by systematic physical treatment, good food, or training the 
intelligence quotient has been raised to 135,^ We may well say 
that the test did not got at copricity but merely efficiency at the 
time. To what extent we may infer capacity from efficiency, 
in the case of any test whatsoever, can be determined only by 
careful study. 

' Just such ft casQ I 10.3 Ijgqil mcontly reported by Juno F*. Dowaoy, 
Journal of Applied Psychology, Vol. XI, 1927, page 52, OtUec svich oaaoa 
have como to the writer's attention. 



A STUDY OF THE RELIABILITY OF MENTAL TESTS AS USED 
IN OKLAHOMA CITY 

C, L. CnaHMAN 
Oklahoma Cily P'ublic Schools 

This study is given ns a contribution to the available infornnatioQ 
concerning the reliability ol mental testa vfben given by class room 
tcachere. 

In the Oklahoma City schoolB it haa been the policy for the past four 
years to give each child entering the kindergarten or first grade a Binct 
Intelligence Teat. These testa are given at about the time of entering 
the first grade. The plan in Oklahoma City has been to train all of the 
primary toachers in the giving of individual teats and to have each 
teacher rcsponaible for testing tho pupils of her own room, In the in¬ 
termediate grades pupila arc retested with the Otis Self-Administering 
Teat of Menial Ability. 

For a number of years the permanent record enrda in the schools were 
not forwarded from school to school with the transfer of children but 
each school made out a new card for every entering child regardless of 
where he last attended. The data for this study were assembled from 
these duplicate permanent record cards which arc now in the files of tho 
Research Office, 

The time intervening between the two tests ranged from one month 
to more than two years with an average interval of between eleven and 
twelve months, 

It is true, of course, that in certain reapecta the children represented 
in this study are not a typical group. That is, they arc drawn from tho 
transient element of the city^s population. Tlic fact that the average 
IQ., derived from the 352 Binet testa, included in these figures Avaa 
100.3 and the average of the 168 IQ.’a derived from the Otis testa was 
96.4 would seem to indicate that the group was not an inferior one, It ia 
entirely possible, however, that other factors enter in to make mental 
tests less reliable with this type of children. 

Tal)le 1 gives tho main facts relative to the reliability of the tests as 
shown by this st\idy, An examination of this table will show that as 
used in Oklahoma Cily the llinct and Otis teats are equally reliable. 

Table 2 is built to sliowthc tendencies of tlm IQ. within the different 
portions of the total di.stribution. In this table only tho Binet tests are 
considered. This tabic shows clearly two things; first, the reliability 
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cliataacft by which aiicliBcoree aro probably too higher too lowincr&ages 
with every inorcftae in distance from tho mean. Ifcwill be noted that in 
Hl)i to of tho small number of cases in some of the outside colvunna there is 
no exception m this tendency to rogreas toward the mean anywhere in 
tlio tabic. 

An examination of the two tables would seem to indiento that with a 
testing program organized such as Oklahoma City's little importance 
should bo placed on tho mental acorcaof tho extremes of the distribution, 
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TEE WILE-TEMPERAMENT OF INDIANS^ 

THOMAS li. GAETH 
UtiivcrsUy of Denver 

AND 

MAEY A, lUllNAIlD 
Colorddo Psychopathic JlospiUil 

In these raotlern days the tem racial tcinpcvanient has a 
very well established usage. AYc seem to see in tlie Chinaman 
one sort of temperament, in the Negro another and in the In¬ 
dian another to say nothing of Italian temperament and Irish 
nature. It would be hard to shako the faitli of lattcrday mem¬ 
bers of society in civilization away from such a belief. Some¬ 
how wo havo come to think just in this way and wc Imve not 
asked onrselvca the question if these temperaments are after all 
really racial, tliat is, native and not acquired. It is tiriio that 
psychology were seeking to answer Iho question as to whether 
or not there are such things as racial tcinpcranumts. 

Efforts have been made to study the temporamont of the 
southern Negro scientifically (1), (2) and the device used for 
the purpose was cither altogether or in part the Will-Tcmpera- 
ment Test devised by Dr. Downey. The results of these studies, 
one by McEadden and Dashicll in North Garolina and the other 
by Siinne in. New Orleans ore indicative but not conclusive. 

The writers recognize the inadequacy of alltestsof personality 
used so far in making studies. This would include of course 
the group test devised by Dr. Downey which we arc using to 
study Indian personality but we believe, with others, that it is 
the most promising attack of temperament yet made and that 
it bids fair to have a tvidc application as it is more niul more 
perfected. 

^ Pupor rcwl before I'^eol.ioii 'II, Americftii Asaociahoii for Adv^nico- 
ment of Science, Decomhet* 20, 192Q, at Philadelphiii, Pa. 
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PROBLEM 


The problem here is: 

1. To obtain, if poasible, reliable measures of full-blood In¬ 
dians for the various tests of the Group Will-Temperament Test. 


TABLE I 

Scores Oblaiiied in Croup Will-Temperamejit Test hy lOt Tl^fti/es and 
170 Full-Blood Indians 
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* Per cent of full-blood Indinna abtftining and exceeding the mcdlon 
of the Whites. 

[k) Speed of Mo-vement; (B) Freedom from Load; (C) Flexibility; 
(D) Speed of Dccialon; (E) Motor Impulsion; (F) Self-Confidence; 
(G) Non-Compliance; (H) FinMity of Judgment; (I) Motor Inhibition; 
(J) Interest in Detail;, (K) Coordination of Impiilsea; (L) Volitional 
Perseveration. 

2, To comparo these with similar measures of white individ¬ 
uals so fts to ascertain if the groups behave differently when so 
tested. 
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SDBJECT8 

Tbeie were two groups of siibiccts. One was a gi-oup of 101 
White students in a High Hchool of llic City Schools of Henver. 
All but 5 of thtiSG were from the cinventh and twelfth grades and 
a\\ bat 7 weve from si>ventcen yettvs ami on in Of these 7, 
one waa fifteen years and the ollicra sixteen years old. The 



-1 Wltilca; o-o-o, linliniia. 

Fio. 1. SiiowiNQ White and Indian Gnoei' Phofji.hs 

sexes wei'O about equally divided there being 49 girls and 52 
boys. The Indian group -waa composed of 170 full-blood In¬ 
diana from the United States Indian Schools at Santa Te and 
Albuquerque, New Mexico, and Rapid City, South Dakota. 
There were 85 boys and 85 girla. About half of the group were 
full-bloods from sedentary tribes being nearly altogether Pueblo 
Indians; the other half were from different nomadic tribes, 
mostly Navajos, Apaches and Sioux. 
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Adminisiraiion and scoring 

The accepted technique of administTation of the group test 
woa followed as closely as poaaible although it ia realized that 
the technique ia very difficult of execution. There was much 
practice by the experimenters in administering the test before 
the tests were given from which the data in table 1 were ob¬ 
tained. In scoring the teats the writers had some valuable 
assistance from the author of the tests for which they make 
acknowledgment. Ecgardlesa of these aafeguarde it ia felt 
that variations found in these results may be partly due to 
variations in technique and scoring. 

HANDLING THE DATA 

In tabic 1 will be found the Medians and Quartiles of the 101 
■White subjects and of the 170 full-blood Indian suhjeGts for 
each of the separate test items and for the total score. There 
will bo found also measures of overlapping of the Indian meas¬ 
ures on the white medians. Figure 1 gives the group profiles of 
the two racial groups. 


interpretation 

In the first place it will be seen from examining the medians 
of both racial groups and the profiles that there are points of 
similarity ns well ns difference; this ia true on a basis of mere 
medians. But it will be noted that in some of the tests in both 
racial groups there is high variability and that therefore such 
medians arc somewhat unreliable. This is true in eight of the 
tests for the white group and six of the tests for the Indians. 

If one takes into consideration the overlapping of the Indians 
on white medians it will be found that the racial differences 
indicated by the medians in tests for Speed of Movement, Speed 
of Decision, Motor Inhibition, Coordination of Impulses and 
Volitional Perseveration indicate real dilfercnccs as found be¬ 
tween tlio two racial groups. 

The overlapping for total score also indicates a tendency 
toward a real diffcnmcc in that respect. That is to say, the 
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test indicates that the Whites oyc aoincwliat iiiovc, speocty thtui 
the lull-blood Indians in so far as the teat indicates what it 
claims to test, They are just the fimuc in llcxibility but much 
more inclined to make ({uick decision than arc the Indians, In 
motor iinpulsiou the two racial gi’oups am jusb about the same 
but the Whites show a greater amoviut of wdf-con (idoucc than do 
the Indians. In non-coniidiaiicc the rcHulis for the two groups 
are not very conclusive though the Whites arc sligliHy stronger 
than the Indians it would appear upon compai’ing mere inediana. 
The same may he said of finality of judgmeiifc although there is 
more siinilniity in the two group measures arul theresults appear 
more trustworthy, i.e., both group.s nj)peur rather strong in this 
respect. In motor inhibition the Indians certainly have the 
better of the Whiles though they are slightly more variable. 
In fact the test indicates that this is a rather strong trait in the 
Indian group and the weakest trait for tlic Whites. In interest 
in detail tlic racial groups aro again rather similar though 
the Whites are less variable. There is a striking WL}akne,ss in 
coordination, of iinpnlRca La the IiuUauB as here measured. In. 
this respect the Whites arc (according to the author of the te.st9) 
just about noi'iiml, The clifFcreiice Hccin.s to be genuine tis 
measured, On the other hand the Indians attain a very high 
score in volitional perseveration and the variability is excessive 
under the civcumstanecs wheveua the score of the Whites is 
much lower and their variability is high. If we may take the 
total score aa indicating strength of personality the Whites 
would appear to have stronger personalities than the Indians. 

COMl'AUISON WITH NEGROES 

Unfortunately the tests given to these Indians were not the 
same as those given by the inveatigators mentioned above but 
we may make a rough comparison- MncFaddon and Dasbiell 
conclude that the Negroes tested by them were slower than 
their White group andin this respect the fiiulinga for the Indians 
arc similar in that they arc slower than the Whites, They also 
found the Negroes to be quicker in the matter of speed of dc- 
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ciaion thau the Whites md we find the Indians slowev than 
Whites. These investigators found the Negroes more solf-confl- 
dent but we find the Indians less so than the Whites. The 
Negroes were stronger in motor impulsion than Whites but the 
Indians nto here found to bo similDX oa measured. The Indians 
and Negroes seem to be slightly similar in being weak in non- 
complinneo as compared with Whites. The Negroes are 
wcftker in motor inhibition than the White group with which 
they were compared but here the Indians excel the Whites. 
Both the Negroes and these Indians proved weaker in coordina¬ 
tion of impulses than the white groups with which they were 
compared and in volitional perseveration the Indians excel 
Whites while the Negroes fall below them in this respect. 

The last finding of excellence in volitional perservation ia 
supported Ijy a fuidiiig by Garth (4) in his study of White and 
Itulian and Negro work curves where the Indians held out better 
in n continuous task in addition than cither Whites or Negi’oes 
although the Indians were nomadic Indians. tILs findings for 
sedentary Indiana showed them oa not excelling in the work 
c\n*VG test (5). 


SUMMAUY 

When Indians ni'o lo,stod wibli the Group Will-Temperament 
Test and the re.^ults are compared with results from testing 
Whiles of similar age we find: 

1. The coinpaiLaon of the total score indicates that Whites 
po.H.sas.H .stronger ])orsoi)alitics tlian Indians as here measured. 

2. While the measures of various traits in both racial groups 
ehow great variability tho.sc showing least variability are: For 
Indiana, Speed of Movement, Flexibility, Speed of Decision, 
Motor Impulaion, Coordination of Impulses, and Volitional 
rersevoration; for White.s, Flexibility, Motor Impulsion, Motor 
Inhibition, and Interest in Detail. 

ih 'i'lie greatest (lifferences between the two racial groups as 
indieatrd by measures of overlapping are to be found in Speed 
of Movi'iiu'iii, Speed of Deeision, Sclf-confidcnoo, Coordination 
of Iiii])u1s(;h, Vulitional Fer-severntion and ?^lolor Inhibition. 
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4. Intcrpictcd U\n above raeaiw that the Whites are irvoye 
speedy in the teat than arc the Indians, they are quicker in 
inakiag dcciaioiia, they arc ratiici' nioro aelf-conlidcnt, they 
have less motor inihbilion, better coordination of impulficg and 
arc poorer in volitional pemvcratioin 

5. The greatest did'erencea ns found hero l^et'weori tlie races 
arc in speed of movement, spectl of dccifiion, coordination of 
impulses and perseveration. In only the hist of these does the 
Indian excel. 

6. It is rather dangerous to venture any conclusion with 
reference to comparison of Ncgi'O and Indian Temperament 
but it would appear that Indiana are less speedy in decision 
than are the Negroes and they appear to be more given to motor 
inhibition than the Negroes. 
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THE rOUIlTH INTERNATIONAL CONGRESS OF 
PSYCHOTECHNIQUE 

PORTIA HOLMAN 

Officiul lnlerj)releT andAmsLani to Dr. Laky 

Between the lOtli nncl 14th of October, 1927, the fourth 
International Confei'cnce of Peychotechnique wag held at the 
Institute of Intellectual Cooperation of the League of Nations 
in Paria. This society was founded in 1920 by Professor Clar 
parGdc (Geneva) with the aim of miiting at conferences and by 
other means nil those whose work and interests are in 
paychotechnique. 

Its conditiona of mcmbci'Bhip are very elastic. There are no 
fees and no avticlca to subscribe to; its chief purpose being to 
unite as many psycliotechniciana as possible so as to be truly 
international an<l Toprosonlativc. 

The Paris Conference was llie first since 1922 and by the gi’eat 
increase in attendance ng in other ways I’dlectod the development 
that hag taken place in tliis science in the last five years, 

The wiahe.g of its founders that a large body of acientists 
representative of a large number of nationalities should be 
brought together wore fully realised. In particular it was the 
first time dolcgatcg from the United States of America or from 
the United Soviet Republic of Russia had been present. Con¬ 
sequently it wag the first meeting which can be considered as 
truly I'cpre.'^ontativo of the trend of psyehotechnical development 
in all parts of the world. 

If that trend may really be judged by the views of the repre- 
sentatives at this conEcrence, the meeting had a Bpecial signifi¬ 
cance in marking the stage at which the science of psychotech- 
niquo hug now arrivrcL 

Ah Mr. Lahy expreasi'd it in his report the conference appeared 
fts a “imljlic and iiiteriuilional examination of conBcience/' 
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This impoi'tcLut mectiug seems lo Uiivo hcoii lii ticcorcl with, a 
gencTnl desu'c on the part of pHycUotccUniciiiuH in iiU cmintrics 
to get into closer touch with one anollicr, to fuul out more clearly 
what ia going on clfiewherc ftiicl to create liJirmoiiious coljpci'iition 
between the vcscarclica and invcstigntions of diricreiit countrica. 

There was a very general feeling tlnifc tlie n?laLiv(i inolatioii of 
psychotcchnicians in any one country ninl tlioir ignorance of 
what was taking place elsewhere had led to loo great a iniillipli- 
CEfcion of effort in the same field luul a Uksh of valuable eonipari- 
sons because in different places investigalors luul worked on the 
BDme material by similar but not strictly identical mcLlinda. 
Nevertheless one of the most striking comdusioiis to be drawn 
from the conforciicc was that, notwitlistanding tlie almost com¬ 
plete lack of cooperation in tlie past, w-orkers in dilTorcni conn- 
tries had arrived iiKlcpcndontly at the same metliods and hac 
tlio same ideas as to the broad niid general lijics of the science, 
At the eoidcvcnce there was a definite unity given by the unv 
vGi'sal interest in general questions of inetlunb coirtrol aiic 
interpretation. No matter what topic was l>oiiig clisciis.sc( 
almost invariably it was lo this aspect of it tliiit both the paperi 
read and the sub.sequcnt discussion were directed. Indeed, tin 
whole question of method and of the place of inatluunaticM aiu 
statistics in paychotcchniquc had been given rtpccdiil prominonci 
in the program, From this discu.sslon two outstanding problem 
arose: (1) the use and reliability of the correlation coollicicnt 
(2) the question of the constancy of .subjoets, i.c,, the rolinbilit; 
of a single test ns the measure of tlie subject's capacity, 

This second question which clearly affects the whole proccdiir 
of psycliotechnical investigations aroused the demand for 
“gigantic international experiment" as one speaker well putil 
Among the cliacussioiia of particular subjects one might atres 
the question of teats of character na being of aixjcial interest to th 
conference. There was a general agi’cemeiit that for purpose 
of vocational guidance and selection existing tests are far froi 
fulequQte. It was felt to be most urgent that attention should h 
directed to the problem of supplementing them both by those ( 
moral qualities and by tc.sts of the higher uumtal qualities, fi 
example, organising ability. 
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Hostesses .^ve Some of the Guests at the Afternoon Tea 
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T]io hoadinRs wliich iliriCiisHitin look jilacF Prin¬ 

ciples aiul Mciliod of Psychoteelmunie, 'riic iMhiciihilily jiiul 
CoiifitniK-y of Siilijeols; Thn (ioikm'uI Quoslion of IVsls, Tho 
Problems of 'rniiiiiuR (of spoeial skill), M’ln' Ht'lalion of Psyeho- 
tccbui^iue (□ IkUiealuHi, 'I’lie llelaliciii nf Psyeboleelmupie (n 
Psycliiatvy, The Question of SekTlioii willi Sjieeial Ht'b'nmce lo 
Ti'(iiisj)oi't Services.* 

The one iinsaiisfacLory featuro of the (■onfercnei’ was its 
brevity, It is, of eoiirse, of the iinUire of a eonfeicuee ihiit it 
slioiilct Inst ojily four or five days Iml it vas piiiiieuhirly re¬ 
grettable in tlii.s inslancf* bemuse the iiuiiiIkm’ of jinpeis was 
exceptionally large. The problems mising (ml. of (bein might 
profitably have been di-senssed for a j-enr. 

Tlio number of papers was ho greiil that iiuiny will be coin- 
nniiiientccl for the first time in Uu* proceedings of the confeaxauKs 
lo be puldisUed slnnlly. Of those wliieh were read lime per- 
raittccl the clisciis.siou only of a small luiiiiber and frecuumtly with 
a lime limit. 

liiiffcreiiccs in Innguagea an<l the lack of liino for compete 
translalion.s presented another olistae.Ie to (’.xclmngt'.s of vii'V's, 
At least ihei'c was inj lack of iirivnli; discussion b(!tween tho 
crowded se.ssion.s and, as wc have noted llb^v(^ in spile of Jimte- 
rial difliciiltics the general inaids of uhais W(!ro \an'y elearly 
mnnifestod, 

Most of the ineinbers present were in ugrccaiumt with tho 
views put forward by Mr. AYilson (Tiondon) in a sp((cial 
paper dealing with tho orgniiizution of the association, Ho 
argued that the assucintinii should be moi'i! than a niur(j 
agency for holding occasional conferences and tliat as far as 
possible continuous investigations of an internatioiial chai’iu*t('r 
should go oil in the inevitably loiiglhy intervals between 
conferences, In partieiilar the association niiglit usefully 
perform the function of codifying and bringing together an 

1 The pii])ei's on Lhia subject were rciwl at a Hpcriiil inccLiiig of Uio 
paycliolcchniuiil Ichoratory of Lha iSaeietC do 'rraiiHpnrLH cii ('otinmiti 
<lc la JlfiRiou Piii’iiHionno in whicli incinherrt wei'o nlilo to Nupiilcanunb 
disenaaion by an itiapcclion of tlic pmclicii in this lahoniLory. 
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authoritativd sIiiIchumU. of tin* work wjih boirif^ done iu 
each (irld iu (‘very coiiiiiry .so (hat cvni uillioul, (i(‘lib(*mte 
collalanotio]! psyfliotocliJiiriMiis in dilTcrcnt conntiic.H niiglU bo 
ill a posiLioii to puisuotlic sinnooinl.s by (ho wiiiio mranis. 

Ill view of the KC'iionil aKi’eeineiit (lui(. pH3sdu)loc‘liiiir{il experi¬ 
ment <ijm ill general give valid vesulls only wlioii (hoy are niadc; 
on very large iiiinil)Oi\s of .siilijod.s i(. was urged lluil. all poswiblo 
fiLep.s should he. taken to fiieilhatc (ho making of sirietlj' eoiu- 
parnbln invostigalioiis in dilTerent lul>oniiorio.s. 

It was also felt (hat certain .subjeshs iiiiglil Ih’sL be iiiV(\stiKatfid 
by an internatkmal commission. In response to (bis feeling 
topics for discussion by a nmiilKT of coiinnksioiiK weie put 
forward and for tlio.so on wliicU the coiiference agreed a president 
of tho coimnission was clecii'd. 'J'he coiiferi'iice delegated to 
each president tho task of choosing the conimissioji’s personnel 
and Uiat of dotormining the niaimer in which it will work. 

The Commissions arc as follow.s: 

1. Paycliolcrlmiciil Study of Ai-cuIoijI.h. I’rofeMHor Miiihr (^Vnrtz- 

iHU'fi'). 

2, 'J'ho iiilldciioo of tho Kiivti'otimont on the Woiker. Mr. ^Vilnnii 

<rii(lusO'iAl Fatigue Itosfuu'ch lluunl, [^ondonj, 

Ih Study of iCdiK'idiiUty. 1‘vufcsKor t'Uvpuvi^.dc fdvuuvivb 
4, The IiilUiuiK'c of the Kxcrliim of the Worker nii Oiiliait, Pio- 
feHJjov hi])iiuuni (.lUirlin). 

f), The Pi’iictical Moasiii'(‘« to bc'Cakoti to Form a Ciomplelo Collec¬ 
tion of ICxirtting TeslH, wilh De-HcripCionfi of McIIumIh iiiid 
at) fiiV t'bliviiwd. I’vnfesaor I’iftvou, Uhu’iHi, 

6. An ALtempt to Unify the I'sycliotcolmidul Vocahulury, Madame 
baumffiii'tcu (.Solciirc, >SwiU(‘r(aiul). 

One or two inpKirtaiit steps were taken witli regard to the 
ovganiwation of the association itself. At a preliminary meeting 
before the oiFicial opening of tlic conference a tentative plan of 
fusion of the Association of International Confeionee of Psycho- 
technique with the International Aasocialion of Psychology and 
Psychotechnique was put forward. This fusion was voted on in 
the opening session and it was siibsecpieiitly decided that the 
body arising from the fusion should Ucueeforward ho known iia 
the International Association of PsyclioLcclinifjue, 
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A general "cnniinittee of direction*’ of this association has 
been Bct up composed of not more than two representatives of 
each country.^ 

The Institute of IntcJlccLual Cooperation has placed rooms for 
the Sccrctariat-Geiun-al permanently at the diaposal of the 
asaooiatioiL 

Dr. Moeller of llign Iiaa hcen asked to undertake the direction 
of an Information Service, by which it is hoped to keep the 
General SccretaHatj ami through it inembors of the association, 
in constant touch with devdopmenta in every country. 

The town of Utrecht hog invited the association to hold its 
next meeting there in September or October, 1928. This 
invitation was accepted by the members of the Fourth Con¬ 
ference bub tho exact date wag not decided. 

Tile proceedings of the eonferenee arc being published and 
members will be informed as soon as posaible of the price at 
which tho volume is available. 

COMlTJiDmii:CTEUll DE L’ASSOCIATJON DES CONFERENCES 
INTICUNATIONALES DE PSYCHOTECHNIQUE 

Boiimgiirton-Troinor, F. (Mine.), Eocteur eu philosophio. Solcuro 
(Sui^Ao). 

llinglmrn, Directoar de Personnel Heflearoh F<5d^ration, president 
(le BAflflociation amdricaino dc psycheloglQ appliquAj, New York, 
ChriatiaenH, A. G. Dirocteur do I'OfUco intorcoinmunal d'orientation 
pro(cHaionn(>llQ do I'agglomdrAtion bruxelloise. 

Clapar(ide, Ed. Dr. Profesaour il I'TJtiiverflitfi do Genfivo. 

Corberi, Dr. Asilo dc IVIontbcUo prda Milan. 

Dccroly, 0, ProfeaBCur a I'Universitfi do Brusellea. 

Ferrari. ProfcHflOur A I'UniverBitfi de Belogne. 

Grnnbftum, A. A. Dr. Docent dc Payehologie A I'Univeraitd d'Amater- 
dam, rddacteur do "I’Adinioistrotive Arbaid,*' chof du laboratoiro 
paychologic|uo A la olmiquo Valerinsplen. 

Jotoyko, J, (Mile.). ProftBBCur de phyeioloeie A i'UjiiversiU de Viir- 
Bovic, prCBidonte de la sociAtfi polonaise do psychotechniciue. 
I.ahy, J, M. Dirocteur du laboratoiro dc psycliologie appliqutfe & 


* Tlio bet of memberfl of UjIb comoiittee ia appended. 
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I'F.acjle pralifRin tlca Iliviiloa lil Ti I'lnf^tiUiL \1 l’ i>aycli()ltjfrio 

de rUiiivci'fiitr: d«! I'lirin. 

Llinnaiin, 0, DirocUcur lic riii.sliliiL dc I'fijvlupltiHit! ii|i]»lif|niio i\ 
lUifliii. 

MilcH, (i. n. Diroc^lnui'-iuliniiil h I’lnaliOit nniiDiuil di; piiycliolo^/jo 
indiiflliic'llc d(i fiOudran. 

Mira, F, DircrLuur d« I'O/Ihhs (r<>rii'rilitlii»n j»r<d<‘,‘?fiiniiii(dJ(‘ A llar- 
caloiK!. 

Mocdo. I'rofdHW'ur t\ 1 'Kju> 1« UioliiiiqiK* do 

DivttcU'UV rinHliUiUi ih pKyrU<iUM-luu<[\H* ludusliFlU' tla (M^ur- 
lottfiihui';!, 

Mynrs, Ch, l)u'ecU!\ir di; I'luslilwl uulioiud do Vi-yriinluinr iudiia- 
trudlu d’l,oiidrcH. 

I’iiioii, II, rrorcHf5CJunm(’«dioj'i}dcjl'rrtnco<‘li\ i'lu.coint rU; I’Hycliolo^iu 
dti rUniveiHiti! dc- IWh, Diwduiir Uh I.ul)oruit'iri' d(' l’,sy('ln)io|;;j(5 
IiliyNiuloKifRifi Soilumin!. 

llcicls, K, 13r, I'niftssHMir s\ l'Fniver.'<ih‘d'l'luM'hl. 

llos.solifiif), (}. I’ror«».sM*nr<U? J)in-i’i(>ur ilo In 

[)i)Ui' KULhidicH tiorvtius'its al «]<> riii>i(ihi(' }ioin'))|i)|r{iiiii^ i\ l(i li'ii'U 
IJuivni'.sili'' (Ic 

iSpiolvuiu, 1. I'Kifftsscuv, dn lidioniU’diro pHyvUiiL(M’lmiq\»i do 

I’liiHLitiit [xiiir 111 pr<»l(M;Uon dii (iiivail Mnsron. 

WojcicclKnv.ski, J. DiuMdour di> I'lii.-iliUit, INyi'lioliM-lmiiim' 

cld <Ui IFilimchl el dn Kmoiui de.s rpu-uvca |):i.vrli(>[i}(>liiii(|iu>.H 

di'a (ilioiiiina tie fer ii Yiirauvie. 

Secretaire (Irncml, ,T. M. Lahy. 

Pmuliuit ijiiifqn^a lu proehiiinc I’tm/wm'ii). ])r. ToulimMe, I'lil. nn’ileciii 
cii chef (lirutdciir du rhOpilnl iHutri UoiMseltu, diitu'leiit- de rinaUUii 
dn p.Hyohiatnu ot dc pmphyliixie menlale I'l'icnlo doH llauUit 
I'tiidoH, PariH. 



NOTES AND NEWS 

Tlic FoiiTlli Intiirnubionul Conference of the New Education Fellow- 
wliil) met fit Lfietirtio Auguat 3 to 15,10^7. The English Rcpoi-fc of this 
World Oonfercucu ia now ready. Uniler the general theme, ‘The True 
Meaning of Fi'cedom in I'lducation” are tlie sections; Tsychological 
L’leedoTii, Freedom through Method, through Euvii’oiiracnt, through 
(Jo-FducaLion, through Creative Art and through Interaational Under- 
atamliug, AinouR the speakers present were Dr. A. Adler, Prof. P. 
IJovet, Dr. 0, Docredy, Mra. H. Ensor, Dr, E. llotten, Dr. A. Fernbifirc, 
Dr. Did Wau^io, Dr, H, lliigg, Dr. Cnrlelon WashburnD, Dr. Lucy IVilsoa 
niul Sir Jagiulin Dose. The pvico of this English Report is CO cents. 
Agf'iitfj in tlio U. S. A.—llooksliop for Boys and Girls, 270 Boylstoii 
Slreot, JloiiLoii, Mnaa. 

On November 17-18, 1027, under tJic Aij.ipices of Personiiol Research 
I'edeiaLioii a coiifcrcuce dealing with the luiman factors in industry was 
held at tho JIoLid Pcnusylviinia, New York City. The aim of this con- 
forcmcf! was to promoto Hcicntilic investigations of the following: tiua- 
ccptibility to Aeoldent.s and Accident Ilcduclion, Mcosuroment of 
l.L'JuliT.sliip, llie Pcr.'iDjml Iiileryicw: Ita Tccljnitiue and Reliability in 
FiuiL-Fiudiag, and tho Diacovery nad Measurement of Meclmnicfll 
Ahilitiefl, At Llic morning .'lesKions there were papers and reports on 
rcsGui’clioH 1)/ inombci’B of the Federation. In the afternoons groups 
were fornual for round-table diecuasion on the topics given above, The 
clinirijiiiii of the four gjoups hi the order given woie Mr. Eugene J. Bengo 
of tliu Pliiludclphia Uupiil Trnnfiit Company; Dr. F, H. Allport, Syra- 
cuHO Uiiivcrsiby; Dr. Bniec V. Moore, Pennsylvania State College, and 
Dr, M. S, ViLclca, TJiiivorBity of Pcnnaylvnuia, Col. Walter V. Bing- 
ham, Director, Pcraonncl Research Federation, who with Mrs, Bingham 
travLded in EiiroiK) this fall and attended the meetings of the Fourth 
lulei'natioiirtl Congress of Ps)'chotoohiuc[ue in October ill Faria, will 
give a paper ou Recent DevclopniRnta iu Industrial Psychology in 
Europe, 

Cliihl Labor Day will be observed for the twcnty-trab year the last 
week ill Jiuiuai'y, 102H. To make known the facta concerning child labor 
uiiil Lu , 4 Lii- t!u‘ public to dcmnurl their correction ia the purpose of Child 
r.al.ur l)iLy-,Iammiy 28 for synagogues, January 29 for churches, and 
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Jo-nunry 30 for achocilri rind (iliil)s. The Xfttioiuil f'liild Lrihor Onm- 
mittcc, 215 FriiirLh Aveiuic, N. Y., will kgiiiI free ol eliarpn Id imy iri(or- 
CBted perBonfl or groups un of llui Uw of llioir hLuLu und other 

matcrlo.! to old in the observAiiceof Oliitd Lnhor Day. 

Loland .Stanford Umvemity atiuounees llidt Dr. Uolx'rt II, Soiislinrc, 
Tsfttional llGacnrcli FeUnw in DayeiioInKy, has ooiiHlniGled n porLaljlo 
outfit for meftfluring Hcneori-motor eofirdiimtiofifl, Adeoriling to Prof. 
W. H, Miles this apparatus i« to bn eallo.d tbo »Stiinfurd Motor Skills 
Uuit. It inchidca six testa whicl) innko iino of iho some inerJiaiiisrns in 
several different ways. The integmled hcofch uro nil read from count¬ 
ers. A motion piflturo film (JO minutes) has been prepared showiiig the 
unit being domonstmted and used. 

*'Thc Clasaificalion of Pupih in Private Sclwok." Tbo recent report 
of the Tosulu of a ronearch program conducted hy hvonly'six bcIidoIb of 
The Private School Toaohors' Association of PJiilndelphin tlirows into 
sharp GontraBk blio scholantio standards of public sohuols and thoso of 
private schools. The report explains why Ihn same sots of standards 
cannot be used for both, nnd sets forth norms lor aid in the proper closei- 
ricntioD of private school students. The nixlccn Inbles included in the 
report provide norms and ranges for the vnrinus grades in chronological 
figo, mental age and educational ago. The prorediirc in using them is 
dcacribcd and examples furnished. Prico 25 cents a copy. Requests 
should bo addressed to 11. G. Clothier, Chairman, lUvcirfurd, Pa. 

The Intcrnutional Library of Philosophy, Pnychulogy and Scienlifio 
Methods hns made nrrnngomenU with Or. Ilorocc 11, I'higliHh to bring 
out- a Btudenl’s Diclionary of pFychological I’cnns. It is planned to 
treat from 2000 to 4000 terms, including partioul/irly those which atii- 
dentftare apt to meet as BOnnas they rend beyond elementary textbooks. 
The work is designed qb q (Icnning dictionary, Byatcmaticnlly recording 
actual usage rather than attempting to Icgislato. The compiler will be 
very grateful for any fluggestions rcccivod by tho middle of February 
and addressed to him at Antioch College, Yellow SpringH, Ohio. 



BOOK REVIEWS 


A, Mykiihon, M,I). The Phijchology of Menial Disorders, Macmillan 
11)27. 1,'W pp, 

TIiIm book iH Homo\vlint inia-titled, na the point of view of tlio 
author ia throuttliovit iivowodly that of the psychiatrist and not of the 
paycholoRiRt, 

Tlio l)()f)k iij ivriUcn in a style easily comprehensible to the layman, 
Indeed, it ia for the layman that Iho book ia intended. Myerson de- 
Hcrilicfi various onca of the ordinary mental difiordors, telling aomebhing 
of the undcriyinp; causes so far as they are known, and suggeats what 
hIjouIJ he tljc social attitude in regard to the psychiatric patient. His 
whole dificuasinn Heems to bo eminently aano and praabicnl, 

While admitting that psychiatry may bo of great aid in solving the 
problem ofcriiiio, ho inflints that paychiatry cannot do it (ilUncUhat the 
proldcin is mainly a social ono and nob one for the physician. 

The book is well worth the fending. 

EnwAruj Anukiju'S liiNCOLN. Sez Dijferemea in the Growlh of American 
School ChiliJren. Warwick and York, Inc., lf)27. 109 pp, 

In this little volume, Lincoln has gathered together and Bummarlzed 
practicuKy nil of tlie invostigationa which have been made on the prob¬ 
lem of sex differences oi school children. It is to bo notod that he litshs 
his discuHiiliui specifically to cluldrcn of school age, and his Undings can 
bo extended to ntluUs only as tonUtivo pTojoctlons. 

Ill general, I/incoln's results aro negative; that is, dl/fercnccs between 
Llio Jicxcfl are not found or are found in such slight degrees that after 
taking into account the marked over-lapping, no adequate adjustment 
as to BOX is poHBkblo. The above Btatomonfe does not apply to physical 
growth, in which respect girls arc found to be in gsnorci phyaicallymore 
mature in every way than boys of a corrospondiiig age. But in intelli- 
geiicc, in school accompUshmeiit, and invariability no Bignificant diflcN 
ciicca aro discovored, Tlio problem of school adjustment is then a 
problem of adapting to individual di/Tcreacas without respect to se.x, 

D, Rtaucii. Psychology. Hovised Edition. Macmillan 

Cmnpaiiy, 1027. 608 pp. 

To tlio one who is already acr|iiaiuted with Starch's earlier book, 
little more comment concerning the present volume ia needed than, to 
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fiuy Unit iL i.s wiitlrn finiri vrry niurli llii‘ f-iuiu* in'iiil «i( virw junl li;is 
l)(!i!ri hroii^lit on l.h(i \vlinl« vi‘ry well up to Hiiln. ’I'lii’ mm piuiiculiir 
luldilinii in fi very bnc'^f «’Inipl(4* on Mviilnl n •dmiHci- wliji-li i.-j 

probnldy Luo bricd In \\i\ oF vin-y urcat v:i\in!. fu Ibc liiOit llm H't’i'iit 
dirtriifisioiiH coiu'cniiiin inHlinf(, niatiy wmiUl 3n»Vf lil.fil in i;i'c (Ik- suli- 
jnc.L tr(!(iLi!(l IL liUlii iiuih; hnnully. •'^Inrcli'iMiwii lirliri' in (In- 
of Ihc iliHniHHimi, hu\vi‘-\M-r, imif nnjTsi'wuvuuil Imviud ni-pici't, nf ii. 

Most (»f dm I'lM'tnii. invrsdKiltioiiM of luilimii ImIiO’JiI iniml l’;-yclifil(i|’y 
Inivfi fiuiiid tlicir way iiih>llm lioiik. 'I'lm rnvinuiT fimlw (Imi I hi- vnltmu- 
^^•nnUl of uim'a priULdvnf vninn. i( wniw of Urn Mnmlnnl IcsU 

ilKGil ill MiC! iiivoHl infillUJiiH nslftlitin In miliiinl -i wn i* nf iiiori* rct f-iit 

diLlo. In iniiny iiiKtiun'i'a rcfororicoH nrc mudo («i H'l.ls v lii'di liiivi- lom; 
sinc.d haul HupiilivtUyd. It w of t-milx’ (istupinMlnu-i liisk tn Lm-ji np witli 
(ill of thn new IcrftH wliiidi uro IndoK rlnviM-d, nnd n Inmk of Llijn sort 
sliould iiob 1)0 c'\]ip(!lml In lihl all of I lioin, llmsvvm'i (Ijii aliilrjnoiit 
tlinb "fnv inonHui'iniT gcnnrnl nmiil hi wHUcmi ooinim-.iiirni l\ri> hi-iiIo .4 
liavc been roiiHlnioUid'' woioh Imrilly up In diiln d liilirn nihii'). 

Aaiii thfi curlier edition, a liirno |M'o|inHi(m of dm (c.vl, ii]i|H'oxiniii(i'ly 
forty piM' eont, in ii;ivini (o ihc |wy<:lMd»*Ky of Holmol fOibjcris, dins I'eiliic- 
iii|{ Llie value of tlio bitnlc for a dcpiirhiicnl in wliirli a n(>)iiiralc ('ouisc i.s 
Kiven on tliOHC lopicH. I'or a K‘*'"*rnl couij-m*, hiHicvm', (liin prolmbly 
ropvRScnta llu; tu'.it Imok aviiilaUlc. 

1). .A. Winn i:s'n;ji, 
of A'tfn-u«/;)(, 

Ja'NJ: lIliJAi'.iL UiInHiinlln liilrndnclitio by ,lo!rp)i Collin, 

M.l). AIiinniltitTi ('oiiipiiny, New Vnik, 'Jllj pa^r.s. 

MiHii Ilillyor, llic sane, iiilcllii'ciit iici.'iiii), in oI'Ik In .Htnnd ii-iidii fnnn 
laM'uelf, it woro, and view Minii l[illyni', (he p^-ycliopiifh, alinn.sl iih 
fibjiniLivc’ly as Llioiiffli hIu; were \'ii‘winK .snmenne rlrnc, pnl, dm .mitin 
Mias Ilillyci' ronu'inbcrH an vividly iiiiniy of llm iiieiil.nl ONiii'iii'iiin's of 
the insane IiIisMlliUycr that win* is aU\i* In ^ivc dm niudoi- lln' .subjcclivo 
UH well us die nbjcr.fivw view, 'i'liis i.s ji radam awkward way of siiyini; 
tliabalio is fddc In dc.sorlbc (he cxpci'ieuci! of Kniiij; era/;_\' widmul iiuliilj'- 
iuR in wL‘\[-]>ity or bystinicH abmil hevrudf. Uov imi*u\ui( imdn-U's mui'b 
that the .serious HtU(U!ii(.of ineiilal piLl.liolo[>y would wish In know. IStrino- 
tliing of licr lioriMliLy, niiicti of her cliildlmnd and l'Mi Iv lioiim oiiviiiiii- 
ment, thu In-eiikdowLi, \v\v luiapilal espei'ieime, Umu periods of oidivimii 
an iibLempt ut Hiiiuide, retiiniijig iiilnvsls and judividrs, die ii'lurn (n 
her own world while yet hut proeiirinusly bulanrud, and die Innr-; Imjiefiil 
Bti’Uggle Hull, one infers, in alill kiuiik nn lo naiiaiii um'imilly Imallhv 
tuiiiilcd, The writer displayH a Icreti iiiKighl. iiiln (lie eiLU'-i'.s m' her 
trouble, nod iinm; pari li'iilarly Uie furtnr.s euh'rni)<; in In ber rnslmuiinn 
to mental heall li. 
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Sl)o ljn.s ft vory uniisnnl nncl very interesting story io tell. She tella 
it IjcftiilifiiUy, Himi)ly, and with a touching reatrainb, Neither confess¬ 
ing nor ItonsLing, she merely rclatca^ nnd it is in this objective viewpoint 
tlmt imicli of Llic value of the work lies. 

In luM introduction Dr. Collino, bcaidcfl assuring the reader of hia 
belief in Clio genuiiicuoKa of Mias IliUycv'a experience and disonssinE 
Home of llin Htilicnt poinls of her cnac, presentB the pflyohiafcrisfc'a view 
0 / Imw /noiilftl Jibnormnlily should be regarded. 

Ajioa C, Andekbon^ 

Ohio Univerail]/. 

E, JoiiDAN. The Life of Mind. Charles \V. Laiit & Company, Indianap¬ 
olis, Incl,, 1025. S24 pp. 

Jordiin'H ‘^Lifo of the Mind” develops into little more than the au¬ 
thor’s own rfttlior nnnowplMlosophy of anon-scientific life. The general 
trend of the Ijook ia that belonging to an era that had been buried, 
Hupposotlly, for at least a decade. 

Although following topics that are closely allied to those found in 
any elementary textbook of psychology, the author disdains bo mention 
prauLlcally all of tlie usual Uy]>olhescs except in a most derogatory way, 
—not for any conatiuctivo reason, but seemingly merely because he 
is violently opposed to anything that may bo termed "gcientific.^' In 
spile of bliU alatod viewpoint wo find him turning to the Bcientiho dis- 
eovorics of phyniology and otlier sciences when an explanation of sensa- 
lioiiM is desired. 

The section dovoted to auditory eonaaiions is typical of the whole 
book. Noises and tones arc bo bo dietingiiUhed not because of dilTercnt 
charnctcrisLies of vibration rate, but merely from the assumption that 
the htimitn bGirTg- "hkos” tones find “difiltkcs" noises. Because o! this 
noise iiHSOcialion with the automobile, this happy vehicle is referred to 
by the author as a ''spawn of the devil.” Could this be a defense mecha¬ 
nism? 

Due bo its own style, and to its obscuro birthplace, the book, fortu- 
natoly, will have lUtlo chance for n popular Ufo, Ita contempoTariea arc 
thoHC! thnb saw the light of day Ln the eighteenth century, before the 
advent of the laboratory. Modern psychology Attempts to advance, 
instead of retard ns this book glories in doing, accurate and verifiable 
cxjdmjalioMB of human conduct, or behavior. 

S, L. Chawley, 
Indiano. Universibj. 

Mehiion K. TiioiUHON. The Springs of Hwnnn Action. New York, 
Ih Appleton and Company, 1027. 601 pp. 

All cxhiuitiLivc lilcrary aiinlyais, of native and acquired ''springs of 
human iicliou” written from the viewpoint of popular psychology. Tbc 
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cxporinientnl approach inconspiciioualiy itfl absence. A biblioRraphy of 
Koino 250 titles is appended. 

Caho E, SiiARiion?:. Learning and Liviny in CoUcgc. Eiiivorflity of 
loiva StikdioH (HericH on Aims and I'rngrofta of ItGifonrdi), Volume 2, 
No. I, 1027. 124 pp. 

A Hitnplo, HtruiRlitforwnrd, noTi<leclniien] prr.Hoiilalioii of Lire out¬ 
comes of the niilhor’a work on Lho "(lifted Htiidoiit I’rojecL” niiJer the 
nuspiccs of the National Rcsoarch (]«uiu*.il> during which he Yisitud ovor 
IfX) Amcricnti CoIIoroh. The philiDHopliy of the luMik iimv ho Hintiined up 
in the dicLum“Keep each child buHV at liifl hi;;lK!Ht imturnl level of 
successful aehiovnmftjit and he will bchappyj UBcful and gooil.’’ Modern 
mass tiducntioii is not ncccHHnrily antagonistic to recognition of the 
individual. Iiulividual capacity may beat be recognized, motivated 
and rewarded throiigli same fourleoii procedures, wldch, in the aullior'H 
opinion represent tho cream of tho proccdurce noted by liim;—a college 
qualifying examination, departinculal placement extuninationfl, sec¬ 
tioning on the basis of ability, project tcnchmg, honorii sysloms, honors 
time credit for suporior work, oliniiualion of c«!iii) 0 titive introductory 
courses in favor of buHie omirsGH, ablest Lcuclinr Icuicliing hiisic course, 
vuTiouB aiirvey and orientation couraos, inlellcctual (loinradeship of 
abler Htudents Avitli faculty, cliaractcr record and innliviUion, perHoiinel 
service, junior college, differentiation of fuiictiouH of iiiHtitiitiona—a 
majority of which apijcar in tho hook aa chapter hinnls, No where at 
tho pruHunt time will one find ro condenHod and so rcctdalilo an account 
of tho aims and pliilosophy qf so ninny of the newjir movemontH in col- 
iGgQ education. All who have an interest in liighcr ediicatioii might 
well be urged to read it, 

llKniiKUT A, Tool's, 

Ohio fiialc Univcrnily. 

ICiMiiAw.. Youncj. fionree lioak for Social Psijcholoyy, Now York, 
Alfred A. Knopf, 1027. 844 pp. 

This addition to Uio growing Hat of books on aocial psychology will 
serve primarily tlioBe readers who lack onay nccosa to the literature since 
it contains excerpts from 229 aourcea. Tho author prcflcnta tho subject 
matter of social psychology through the avenue of tlic group rather 
than through the individual. In general, the plan followed ia, (1) a 
consideration of pre-human and human behavior ns determined by Llic 
group; (2) an e.vposi(.ion of tlie bases of soeial behavior us revealed 
through physiological and psychological studies; and (3) jui cxarainatioi] 
of personality ns it clovolopa in group relatioiifihipfl upon Lho triple 
foundation of social group, culture, mid the individual, 

To aoluQvo tho above plan the author divides Llic HoloctiouB under fiix 
main headings: general (eaturea of aocial behavior; pHyoliological founda- 
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tiona of Bocitil liiihdvior; peraonality and social behavior; social aiti- 
tiuloB niul tlic Hiibjcctivo eiivironinont; Icnclorship and prestige in social 
liclmvior; nnd r.olleclive behavior, Tlwjre are 27 chapters, eacli with on 
introclvictory (Uhcumhioh hidicaliiiR the prqbloras reviewed and explain¬ 
ing the inclnsuin of ccrlahi HulceliouB. Queationa and exercises and a 
selected hibliogrupliy follow at the end of cash chapter. These intro¬ 
ductory diii(UiHHiunn nntl cIiihh excrclfloa form an integral part of the 
volume. 

WJiilc \v(i am inftumcd I>y the author that tho compilation is seUclm 
aiui nut exImuHtivc, and (leHpite tho praiseworthy attempt to organize 
tJie cxccrplH nmlor ai.x catcgoricH of social beimvior, one layscfown the 
voliirua witli a growing convintioii thot social psychology is an 
arnorpliouff fiuhjeet; an afTairof theory and little experiment, Admit¬ 
ting tlink fclio aubjoct aa it riowcxiata la not well-defined we may recognke 
tliftt this aoiirco Ijook is truly repreaentafcivo. We find in it, for example, 
hriof glcftninga from the writings of anliiropologiats, neurologists, pro* 
feasors of education, philoHoplicra, physiologists, political scientiaCs, 
pByoholngiHta, nociolngiaba, and a novelist; the greater number of selec¬ 
tions being altributc<l to the aociologists. Not more than 13 per cent 
of Ihc articles ountiiin data derived from experiments and onec studies, 
or, rftgftrcled soniowlint ditforciitly, more than 86 per cent of the pages 
arc theoretical in nature. Undoubtedly the number of non-experi- 
niuntal pupers written under tho title of social psychology is far greater 
than that representing the quantitative or experimental icporte, but 
the oiiheHiot) from Uiis book ot many recent important experimefital 
nrliclcs dclraclH frutn ils uBofiilneee, and contributes to ite chief weak- 
neat) which it) foilvire to exploit the newer psychological approach to the 
field, Ncverthelcaa, Young's "Source Book/' useful to the general 
render, ia a vnbmhlc reference work which promises to eupplemeut the 
conlcnC of courHes in social psychology- 

Charles Bird, 
Universii)j of Minnt^ola. 

IIaiiry J. Hajceij. Characleristic Diffe}-ences in Bright and Dull Children. 

Public School Publishing Company, Clooroington, III,, 1027, IIB 

TP- ^ , 

PeiOTC iiilolligeTicc quotients and mental ages can have much bearing 

upon our acliool practices they roust bo translated from figures into facts, 
'I'liGae facts must be stated in terms of aptitude for school work, attitude 
toward Htiidy, metlioda of learning, rate of progress, cto. This has 
been done for the sulniorronl cliild in several recent books, and to some 
extent lias been attainptcd for the gifted. The dull and the bright, 
luiwtivev, have not received their due share of attention. TJie author 
1ms wrillcii tluH little volume in an attempt to interpret the IQ s which 
lie lietweeii 70 niid 90 and those between IJO and 130 in terras of school 
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work ond procicdiiro. Tkc Jormcr Rroup be “chill" nnd the latter 
"bright,'' and the Ijook is concorned with eojiLrastiiig ifirwo two grcjupa 
witli respect to lliGir naUircH and behavior in vnrimis Ndliool Hituations, 

The raaterinl which is Iho Iniftia for iho hook was olilninoil hy uskiiig 
Fivo hundred Dfttioit tcachere to report iipoii these two Kroujw of chil¬ 
dren with rcispcot to "(HReicneen as limy expresMed ihnin in psychologionl 
terminology, upon difTcrenccH iin cxprcflHcd in Lheur tncLliotlH of lenclung 
procedurcfl nnd in nny other wny they wifllied." Tlio luillior tpllfl ua 
that the reports were rernnrkably uimiiiinous, hut he doCH tioL aiiinnm' 
rizG them except as he rolhsots thoni in the eourse of tlic liook. At least 
ono vender is disappoinLcd in Retting no Iwtter view of the oviginnl dntn 
upon whicli the honk iu based. 

Tile opiriioiia oi Fivg hundred touehers ought to fiinilah nn excellent 
beginning on the jirohlcm sot for tliis vohiine, hy providing indications 
of topics on wliicli research might prove fruitful. OpiriioiiH, however, 
ought not to ho conaUlcrcd sufUcicat liaais for n IrcnbiHC on a suhicct 
concerning which facta arc obtainable. As a consccpioneo of using 
opiniona instead of facts, the author lias often been guilty of dogmatism. 
For this ho occnsionally exprcHscs regret, hut tho fault lien fuiidaincn- 
tnlly with tho error of usingupinioimns facts, and HoeniH indofensihlu to 
at least one reader. The author lummiuiy opitiiouH whieli lire plnusihlc, 
hut uthcifl arc highly duhious nnd conlrovcrHial, Tor o.xnrnplc, in 
dealing with the problem u( aimcinl M>iUiic» and lUsuhihiio:^, wo are 
assured that n hrigliL child "scldam Huffers from a (liNnlnlity," while a 
dull child with ft special diafthility has n "Hcrious hiuuUcap,’* On tlio 
other hand the cnmbiimiiou of a bright child and n Hiioeinl tnlenb "fur* 
niahea excellent results," but "aH|>cciAl talent is often a liability to the 
dull pupil." tt is doulitful whether bmcK xiaveriricid opiuious ought to 
appear hi the held of educational Ulcrature, especially whun vevilicatipn 
is possible. 

Fart II of the hook in devoted to the clifTorencos of the two types with 
respect to their work in specific school suhjecta. Here also wo find a 
great deal of opinion and a very small cpiantiiy of fact, We arc told 
that in the eocial etudics that the dull child oxhihibs a narrow nnd selfish 
point of view, while the bright child in the oppoeilo. In immio tho dull 
child waits for others to got the pilch or to load, while the l>right cluld 
has all tho qualltiGB of n good musician. Pull pupils nru "inforjor in 
art;" while "work nnd study in art have always boon a natural gift of 
bright triiiids." So tliroughoiit tho book wo fiml many such stateincnta, 
nnd most of them arc entirely unaupported hy cxpui*liuoiitii.l evidence. 
It may well he true that a lorgo nuinbor of tho opinions arc correetr hub 
it is equally probable that some arc doubtful and olhoro iniNlonding. 

Part III is a brief disciiSBiou of how elanscs nro occlioiiod in Detroit, 
and some comment h on tho LyiMjsof procedures which the author beJioves 
to bo nccosaary for each type of child. 
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Jtrr.rA A, K'n(K^vo()n. The Learning Process in Young Children. tJni- 
verHiLy of lowii KtudicB. Studies in Child Welfare, Published by 
the UiiiverHity, Iowa City, 1020, 107 pp. 

Tills inormBiiipli frivea an account of a study of the learninE procoaa 
in young cluldron. It not only makes a contribution to inloTination on 
how children learn, hut also adds to the methodology of cxpcrimcntiition 
in tiiiH lioUl. Tlic varioua problems studied eenter around the task of 
learning n licrics of IwonLy associations which tho author has cleverly 
(leviHcd. ThcHQ cimHiet of acHociatians between blooka and pictures 
which are not too dlflicult forchcldreu above three yoara (or even some¬ 
what younger), liuh which aro dillicull enough so that only one of seven 
adulta of auperior mentality made a perfect score on the first attempt. 
Thu twenty associations were to be formed withiu twenty trialfl, and 
the associations were declared to bo learned whenever the aubject could 
make three perfect performances in eucccaaion. The author fully dem- 
onatratca that this criterion ia much preferable to the more frequent one 
of a Binglc perfect porfonnanco, or even two perfect performances. 
Furthormorc ahu Ima shown that requiring more than three succesBive, 
porfoct porrorriiatLece would be unnecessary. Tho number of chrJdron 
tested WAH 2o;i, but for various reasons such as absence, etc., the number 
of records tiKcd in tiie report is only 180. The piccaution o/ the author 
in making the conditions of learning standard and in rejecting all cases 
whicli did not conform to these atandai^s is highly commendable. 

A miinlicr of |)rol)lems were studied; learning on suoccaaive days 
verHua learning on alLornnto claye; plateaus; rcloarning after an interval 
of a year; IranHfcr and interference of a set of icarned associations with 
a second BorioB of similar nBsooiabionB; dllToronces between children 
aticttBtorned to psychological tests and those unaccustomed to such tests; 
correlnliona between bvicccsb in learning theas associations and auccesa 
on various iDtolligcnoo and form board tests; and other points oEintereat. 
In all instances the data havobeen collected and handled with precision 
and good judgment. The outlior very wisely refrains from attempting 
toestabliah norma for the various ago groups, and from drawing infer¬ 
ences and coTiclusiona beyond those justilicd by the data. Among the 
things of particular interest to the reviewer was the contrast between 
paired children, half of whom were loarDing on Bucceaaive days and half 
on altornate days, In spite of the immaturity of the children theeiipe- 
riority of learning on alternate doya wog clearly demonstrated for this 
niatoriah Another point of interest was the fact that plateaus occurred 
more frequently among the less mature children than among the older 
ones, 

Tho wholo stufly is intcroBting and well worth the time of any individ¬ 
ual interested in this field of experimental work. 

STtrART M. Store, 

Ohio University, 
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